Medication management

ABSTRACT

The technology described in this document is embodied in a method that includes processing data in a first dataset that represents time-varying information about at least one pulse pressure wave propagating through blood in a subject acquired at a location of the subject. The method also includes providing, based on the data, information about a medication regimen of the subject.

CROSS REFERENCE TO RELATED APPLICATIONS

This application claims priority to U.S. Provisional Application61/894,884, filed on Oct. 23, 2013, and U.S. Provisional Application No.62/002,531, filed on May 23, 2014, the entire content of which isincorporated herein by reference.

TECHNICAL FIELD

This document describes technology related to consumer biometricdevices.

BACKGROUND

Various types of sensors can be used for sensing biometric parameters.

SUMMARY

In one aspect, a method includes obtaining, using a first sensor, afirst data set representing time-varying information on at least onepulse pressure wave within vasculature at a first body part of asubject. The method also includes obtaining, using a second sensor, asecond data set representing time-varying information about motion ofthe subject at the first body part of a subject. The method alsoincludes identifying, using one or more processors, a first point in thefirst data set, the first point representing an arrival time of thepulse pressure wave at the first body part. The method also includesidentifying, using the one or more processors, a second point in thesecond dataset, the second point representing an earlier time at whichthe pulse pressure wave traverses a second body part of the subject. Themethod also includes computing a pulse transit time (PTT) as adifference between the first and second points, the PTT representing atime taken by the pulse pressure wave to travel from the second bodypart to the first body part of the subject.

In another aspect, one or more machine-readable storage devices storesinstructions that are executable by one or more processing devices toperform operations including obtaining a first data set representingtime-varying information on at least one pulse pressure wave withinvasculature at a first body part of a subject. The operations alsoinclude obtaining a second data set representing time-varyinginformation about motion of the subject at the first body part of asubject. The operations also include identifying a first point in thefirst data set. The first point represents an arrival time of the pulsepressure wave at the first body part. The operations also includeidentifying a second point in the second dataset. The second pointrepresents an earlier time at which the pulse pressure wave traverses asecond body part of the subject. The operations also include computing apulse transit time (PTT) as a difference between the first and secondpoints. The PTT represents a time taken by the pulse pressure wave totravel from the second body part to the first body part of the subject.

In another aspect, a biofeedback device configured to be worn by asubject includes a first sensor configured to obtain a first data setrepresenting time-varying information on at least one pulse pressurewave within vasculature at a first body part of a subject. The devicealso includes a second sensor configured to obtain a second data setrepresenting time-varying information about motion of the subject at thefirst body part of a subject. The device also includes memory. Thedevice also includes one or more processors. The one or more processorsare configured to receive the first and second data sets. The one ormore processors are also configured to identify a first point in thefirst data set, the first point representing an arrival time of thepulse pressure wave at the first body part. The one or more processorsare also configured to identify a second point in the second dataset,the second point representing an earlier time at which the pulsepressure wave traverses a second body part of the subject. The one ormore processors are also configured to compute a pulse transit time(PTT) as a difference between the first and second points. The PTTrepresents a time taken by the pulse pressure wave to travel from thesecond body part to the first body part of the subject.

Implementations can include one or more of the following features.

In some implementations, the information about the at least one pulsepressure wave includes photoplethysmographic (PPG) data and theinformation about motion of the subject includes one or both ofmotioncardiogram (MoCG) data and gross motion data.

In some implementations, data including at least one of the first dataset and the second data set is acquired continuously.

In some implementations, the data is acquired at a frequency of at least16 Hz. In some implementations, the data is acquired at a frequency ofbetween 75 Hz and 85 Hz.

In some implementations, the data is acquired by a device worn by thesubject.

In some implementations, the device is mobile and does not reduce amobility of the subject.

In some implementations, the device processes the data.

In some implementations, the first body part is an arm of the subject.

In some implementations, the first body part is a wrist of the subject.

In some implementations, the first sensor includes an optical sensor andthe second sensor includes an accelerometer or a gyroscope.

In some implementations, identifying the first point includes computing,by the one or more processors, a cross-correlation of a template segmentwith each of multiple segments of the first dataset. Identifying thefirst point also includes identifying, based on the computedcross-correlations, at least one candidate segment of the first datasetas including the first point. Identifying the first point also includesidentifying, by the one or more processors, a first feature within theidentified candidate segment as the first point.

In some implementations, identifying the second point includesdetermining a reference point in the second data set, the referencepoint corresponding to substantially the same point in time as the firstpoint in the first data set. Identifying the second point also includesidentifying one or more target features within a predetermined timerange relative to the reference point. Identifying the second point alsoincludes selecting a time point corresponding to one of the targetfeatures as the second point.

In some implementations, the target features includes at least one of apeak and a valley.

In some implementations, the method also includes computing a bloodpressure of the subject as a function of the PTT.

In some implementations, the blood pressure includes a systolic pressureand a diastolic pressure.

In some implementations, a diastolic pressure is calculated as a linearfunction of the logarithm of the PTT.

In some implementations, a systolic pressure is calculated as a linearfunction of the diastolic pressure.

In some implementations, the pre-determined time range is associatedwith the systole portion of the subject's heartbeat.

In some implementations, the method also includes accepting user-inputfor initiating computation of the PTT.

In some implementations, the method also includes computing arterialstiffness as a function of the PTT.

In some implementations, the device also includes a mechanism thatallows the device to be worn by the subject.

In some implementations, the mechanism does not reduce a mobility of thesubject.

In some implementations, the one or more processors are also configuredto compute a blood pressure of the subject as a function of the PTT.

In some implementations, the device also includes an input mechanismconfigured to accept user-input for initiating computation of the PTT.

In some implementations, the one or more processors are also configuredto compute arterial stiffness as a function of the PTT.

In another aspect, a method includes processing data in a first datasetthat represents time-varying information about at least one pulsepressure wave propagating through blood in a subject acquired at alocation of the subject. The method also includes processing data in asecond dataset that represents time-varying information about motion ofthe subject acquired at the location of the subject. The method alsoincludes detecting arrhythmia of the subject based on the data.

In another aspect, one or more machine-readable storage devices storesinstructions that are executable by one or more processing devices toperform operations including processing data in a first dataset thatrepresents time-varying information about at least one pulse pressurewave propagating through blood in a subject acquired at a location ofthe subject. The operations also include processing data in a seconddataset that represents time-varying information about motion of thesubject acquired at the location of the subject. The operations alsoinclude detecting arrhythmia of the subject based on the data.

In another aspect, a biofeedback device configured to be worn by asubject includes a light source configured to emit light toward the skinof the subject. The device also includes an optical sensor configured toreceive the emitted light after the emitted light reflects off of theskin of the subject. The optical sensor is also configured to providedata that corresponds to a characteristic of the received light, thedata representing time-varying information about at least one pulsepressure wave propagating through blood in the subject acquired by theoptical sensor at a location of the subject. The device also includes amotion sensor configured to provide data that represents time-varyinginformation about motion of the subject acquired by the motion sensor atthe location of the subject. The device also includes a processorconfigured to receive data from one or more of the light-emittingelement, the optical sensor, and the motion sensor. The processor isalso configured to detect arrhythmia of the subject based on the data.

Implementations can include one or more of the following features.

In some implementations, the information about at least one pulsepressure wave propagating through blood in the subject includesphotoplethysmographic (PPG) data and the information about motion of thesubject includes one or both of motioncardiogram (MoCG) data and grossmotion data.

In some implementations, the data is acquired continuously.

In some implementations, the data is acquired at a frequency of at least16 Hz.

In some implementations, the data is acquired at a frequency of between75 Hz and 85 Hz.

In some implementations, the data is acquired at a single location ofthe subject.

In some implementations, the data is acquired by a device worn by thesubject.

In some implementations, the device is mobile and does not reduce amobility of the subject.

In some implementations, the device processes the data.

In some implementations, the single location is an arm of the subject.

In some implementations, the single location is a wrist of the subject.

In some implementations, the arrhythmia includes atrial fibrillation(AFIB).

In some implementations, the arrhythmia includes atrial flutter.

In some implementations, the method also includes identifying, based ongross motion data of the subject, one or more period of high activity ofthe subject.

In some implementations, the data that the arrhythmia detection is basedon does not include data collected during the one or more periods ofhigh activity.

In some implementations, the data that the arrhythmia detection is basedon includes data collected during the one or more periods of highactivity.

In some implementations, processing the data includes plotting R wave toR wave intervals (RR_(i)) versus next consecutive R wave to R waveintervals (RR_(i+1)).

In some implementations, processing the data includes determiningwhether a spread of plotted data points exceeds a predetermined spreadvalue.

In some implementations, the method also includes determining that thesubject experienced atrial fibrillation (AFIB) if the spread of theplotted data points exceeds the predetermined spread value.

In some implementations, processing the data includes determiningwhether multiple clusters of plotted data points are offset from adiagonal.

In some implementations, the method also includes determining that thesubject experienced atrial flutter if there are multiple clusters ofplotted data points offset from the diagonal.

In some implementations, processing the data includes determining one ormore of heart rate, heart rate variability, and blood pressure of thesubject.

In some implementations, determining the heart rate of the subjectincludes calculating a distance between two consecutive reference pointsin the first dataset, the distance representing a time that has elapsedbetween two consecutive heartbeats of the subject.

In some implementations, the reference points are local maxima or localminima.

In some implementations, the reference points are peaks or valleys.

In some implementations, determining the heart rate variability of thesubject includes calculating distances between multiple pairs ofconsecutive reference points in the first dataset, each distancerepresenting a time that has elapsed between two consecutive heartbeatsof the subject.

In some implementations, atrial fibrillation is detected if the heartrate variability of the subject crosses a threshold.

In some implementations, determining the blood pressure of the subjectincludes identifying a first point in the first dataset, the first pointrepresenting an arrival time of the pulse pressure wave at a first bodypart of the subject. Determining the blood pressure of the subject alsoincludes identifying a second point in the second dataset, the secondpoint representing an earlier time at which the pulse pressure wavetraverses a second body part of the subject. Determining the bloodpressure of the subject also includes computing a pulse transit time(PTT) as a difference between the first and second points, the PTTrepresenting a time taken by the pulse pressure wave to travel from thesecond body part to the first body part of the subject, wherein the PTTis related to an elasticity of one or more blood vessels of the subject.Determining the blood pressure of the subject also includes determiningthe blood pressure of the subject based on the elasticity of the one ormore blood vessels.

In some implementations, the first body part is the location of thesubject at which the data in the first data set is acquired, and thesecond body part is the heart of the subject.

In some implementations, processing the data includes plotting R wave toR wave intervals (RR_(i)) versus next consecutive R wave to R waveintervals (RR_(i+1)).

In some implementations, processing the data includes determiningwhether a spread of plotted data points exceeds a predetermined spreadvalue.

In some implementations, the processor is also configured to determinethat the subject experienced atrial fibrillation (AFIB) if the spread ofthe plotted data points exceeds the predetermined spread value.

In some implementations, processing the data includes determiningwhether multiple clusters of plotted data points are offset from adiagonal.

In some implementations, the processor is also configured to determinethat the subject experienced atrial flutter if there are multipleclusters of plotted data points offset from the diagonal.

In another aspect, a method includes processing data that representstime-varying information about at least one pulse pressure wavepropagating through blood in each of one or more subjects acquired at alocation of each of the subjects. The method also includes processingdata that represents time-varying information about motion of the one ormore subjects acquired at the location of each of the subjects. Themethod also includes determining, based on the data, a quality of careprovided to the one or more subjects by a care facility that cares forthe one or more subjects.

In another aspect, one or more machine-readable storage devices storesinstructions that are executable by one or more processing devices toperform operations including processing data that representstime-varying information about at least one pulse pressure wavepropagating through blood in each of one or more subjects acquired at alocation of each of the subjects. The operations also include processingdata that represents time-varying information about motion of the one ormore subjects acquired at the location of each of the subjects. Theoperations also include determining, based on the data, a quality ofcare provided to the one or more subjects by a care facility that caresfor the one or more subjects.

In another aspect, a biofeedback device configured to be worn by one ormore subjects includes a light source configured to emit light towardthe skin of the subject. The device also includes an optical sensorconfigured to receive the emitted light after the emitted light reflectsoff of the skin of the subject. The optical sensor is also configured toprovide data that corresponds to a characteristic of the received light,the data representing time-varying information about at least one pulsepressure wave propagating through blood in the subject acquired by theoptical sensor at a location of the subject. The device also includes amotion sensor configured to provide data that represents time-varyinginformation about motion of the subject acquired by the motion sensor atthe location of the subject. The device also includes a processorconfigured to receive data from one or more of the light-emittingelement, the optical sensor, and the motion sensor. The processor isalso configured to determine, based on the data, a quality of careprovided to one or more subjects by a care facility that cares for theone or more subjects.

Implementations can include one or more of the following features.

In some implementations, the information about at least one pulsepressure wave propagating through blood in the subjects includesphotoplethysmographic (PPG) data and the information about motion of thesubjects includes one or both of motioncardiogram (MoCG) data and grossmotion data.

In some implementations, the data is acquired continuously.

In some implementations, the data is acquired at a frequency of at least16 Hz.

In some implementations, the data is acquired at a frequency of between75 Hz and 85 Hz.

In some implementations, the data is acquired at single locations ofeach of the subjects.

In some implementations, the data is acquired by devices worn by thesubjects.

In some implementations, the devices are mobile and do not reducemobility of the subjects.

In some implementations, the devices process the data.

In some implementations, the single location of each of the subjects isan arm of the subject.

In some implementations, the single location is a wrist of the subject.

In some implementations, determining a quality of care provided to theone or more subjects includes determining a level of physical activityexperienced by each of the one or more subjects by comparing grossmotion data of each subject to a threshold value.

In some implementations, the threshold is based on a metric defined by ahealth organization.

In some implementations, the level of physical activity includes anamount of time that each subject has exercised over a particular timeperiod.

In some implementations, the level of physical activity includes anamount of time or a distance that each subject has walked over aparticular time period.

In some implementations, the method also includes processing data thatrepresents information about an amount of ultraviolet light that each ofthe one or more subjects has been exposed to over a particular timeperiod.

In some implementations, the method also includes determining an amountof time that each of the one or more subjects has spent outside over theparticular time period based on the information about the ultravioletlight.

In some implementations, the method also includes comparing the qualityof care provided by the care facility to a quality of care provided byanother care facility that cares for one or more other subjects.

In some implementations, the device also includes an ultraviolet lightsensor configured to measure levels of ultraviolet light that each ofthe one or more subjects is exposed to over a particular time period.

In some implementations, the processor is also configured to processdata that represents information about the levels of ultraviolet lightthat each of the one or more subjects is exposed to over the particulartime period.

In some implementations, the processor is also configured to determinean amount of time that each of the one or more subjects has spentoutside over the particular time period based on the information aboutthe levels of ultraviolet light.

In some implementations, determining the quality of care provided to theone or more subjects includes determining a level of physical activityexperienced by each of the one or more subjects by comparing grossmotion data of each subject to a threshold value.

In another aspect, a method includes processing data in a first datasetthat represents time-varying information about at least one pulsepressure wave propagating through blood in a subject acquired at alocation of the subject. The data is acquired while the subject is in asituation associated with risk indicated by the data.

In another aspect, one or more machine-readable storage devices storesinstructions that are executable by one or more processing devices toperform operations including processing data in a first dataset thatrepresents time-varying information about at least one pulse pressurewave propagating through blood in a subject acquired at a location ofthe subject. The data is acquired while the subject is in a situationassociated with risk indicated by the data.

In another aspect, a biofeedback device configured to be worn by asubject includes a light source configured to emit light toward the skinof the subject. The device also includes an optical sensor configured toreceive the emitted light after the emitted light reflects off of theskin of the subject. The optical sensor is also configured to providedata that corresponds to a characteristic of the received light, thedata representing time-varying information about at least one pulsepressure wave propagating through blood in the subject acquired by theoptical sensor at a location of the subject. The device also includes aprocessor configured to receive data from one or both of thelight-emitting element and the optical sensor. The processor is alsoconfigured to process the data to determine whether the subject is in asituation associated with risk and to derive a measure of a level ofrisk associated with the subject.

Implementations can include one or more of the following features.

In some implementations, the method also includes processing data in asecond dataset that represents time-varying information about motion ofthe subject acquired at the location of the subject.

In some implementations, the information about at least one pulsepressure wave propagating through blood in the subject includesphotoplethysmographic (PPG) data and the information about motion of thesubject includes one or both of motioncardiogram (MoCG) data and grossmotion data.

In some implementations, the data is acquired continuously.

In some implementations, the data is acquired at a frequency of at least16 Hz.

In some implementations, the data is acquired at a frequency of between75 Hz and 85 Hz.

In some implementations, the data is acquired at a single location ofthe subject.

In some implementations, the data is acquired by a device worn by thesubject.

In some implementations, the device is mobile and does not reduce amobility of the subject.

In some implementations, the device processes the data.

In some implementations, the single location is an arm of the subject.

In some implementations, the single location is a wrist of the subject.

In some implementations, the method also includes using the processeddata to derive a measure of a level of risk associated with the subject.

In some implementations, the method also includes identifying a firstpoint in the first dataset, the first point representing an arrival timeof the pulse pressure wave at a first body part of the subject. Themethod also includes identifying a second point in the second dataset,the second point representing an earlier time at which the pulsepressure wave traverses a second body part of the subject. The methodalso includes computing a pulse transit time (PTT) as a differencebetween the first and second points, the PTT representing a time takenby the pulse pressure wave to travel from the second body part to thefirst body part of the subject.

In some implementations, the first body part is the location of thesubject at which the data in the first data set is acquired, and thesecond body part is the heart of the subject.

In some implementations, the method also includes determining a bloodpressure of the subject based on the PTT.

In some implementations, the risk includes trauma to the subject and thedata is indicative of the existence of the trauma.

In some implementations, the method also includes providing theprocessed data to a party that is responding to the trauma.

In some implementations, the processed data is transmitted from a deviceworn by the subject to a remote device.

In some implementations, the remote device is a server associated withan emergency service provider.

In some implementations, the processed data is provided to the partybefore the party has reached the subject.

In some implementations, the method also includes processing data thatrepresents time-varying information about at least one pulse pressurewave propagating through blood in additional subjects acquired at alocation of each of the subjects. The method also includes processingdata that represents time-varying information about motion of theadditional subjects acquired at the location of each of the subjects.The data is acquired while the additional subjects are in the situationassociated with the risk, and the risk includes trauma.

In some implementations, the method also includes providing theprocessed data for the subject and the additional subjects to a partythat is responding to the trauma, before the party has reached thesubjects.

In some implementations, the processed data is transmitted from devicesworn by the subjects to a remote device.

In some implementations, the remote device is a server associated withan emergency service provider.

In some implementations, the method also includes providing informationto the party that enables the party to assess a level of risk associatedwith each of the subjects before the party has reached the subjects.

In some implementations, the method also includes providing theprocessed data to a medical facility to which the subject is taken formedical care.

In some implementations, the risk includes trauma.

In some implementations, providing the processed data to a medicalfacility includes providing the processed data to an urgent caredivision of the medical facility.

In some implementations, the information is provided to the urgent caredivision before the subject is treated by the urgent care division.

In some implementations, the method also includes processing data thatrepresents time-varying information about at least one pulse pressurewave propagating through blood in additional subjects acquired at alocation of each of the subjects. The method also includes processingdata that represents time-varying information about motion of theadditional subjects acquired at the location of each of the subjects.The data is acquired while the additional subjects are in the situationassociated with the risk.

In some implementations, providing the processed data to a medicalfacility includes providing the processed data to an urgent caredivision of the medical facility.

In some implementations, the information is provided to the urgent caredivision before one or more of the subjects are treated by the urgentcare division.

In some implementations, the subjects are treated in an order that isbased on a severity of an injury.

In some implementations, relatively more severely injured subjects aretreated before relatively less severely injured subjects.

In some implementations, the processed data is used to determine thesubject's compliance with a particular standard of care throughout aprogression of steps of the standard of care.

In some implementations, the processed data is used to determine whetherthe subject is receiving care that is appropriate according to aparticular standard of care.

In some implementations, the data is processed after the subject is inthe situation associated with risk.

In some implementations, the processing of the data occurs after thedata has been acquired and with a short enough delay to enable an effectof the risk to be resolved.

In some implementations, the situation includes firefighting.

In some implementations, the situation includes a natural disaster or asudden act of violence.

In some implementations, the risk includes one or more of heart failure,emotional stress, abnormal skin temperature, abnormal body temperature,hypertension, heart attack, stroke, arrhythmia, exhaustion, and anxiety.

In some implementations, the method also includes determining one ormore of a blood pressure, a skin temperature, a body temperature, aheart rate, and a heart rate variability of the subject based on thedatasets. The method also includes detecting emotional stress in thesubject by determining whether one or more of the determined bloodpressure, heart rate, and heart rate variability of the subject is apredetermined amount above a threshold.

In some implementations, the data indicates that the subject is about toexperience an effect of one of the risks.

In some implementations, the risk includes overexposure of the subjectto ultraviolet light.

In some implementations, the method also includes processing data thatrepresents information about an amount of ultraviolet light that thesubject has been exposed to.

In some implementations, the method also includes comparing the amountof ultraviolet light that the subject has been exposed to a threshold todetermine whether the subject has been overexposed to ultraviolet light.

In some implementations, the method also includes alerting the subjectif the subject has been overexposed to ultraviolet light.

In some implementations, the risk includes trauma to the subject and thedata is indicative of the existence of the trauma.

In some implementations, the operations also include processing data ina second dataset that represents time-varying information about motionof the subject acquired at the location of the subject.

In some implementations, the device also includes a motion sensorconfigured to provide data that represents time-varying informationabout motion of the subject acquired by the motion sensor at thelocation of the subject. The processor is also configured to receive andprocess the data from the motion sensor.

In some implementations, the processor is also configured to cause thebiofeedback device to provide the processed data to a party that isresponding to the trauma.

In some implementations, the processor is also configured to cause thebiofeedback device to provide the processed data to a remote device.

In some implementations, the remote device is a server associated withan emergency service provider.

In some implementations, the processor is also configured to cause thebiofeedback device to provide the processed data to a medical facilityto which the subject is taken for medical care.

In some implementation, the device also includes a transceiverconfigured to provide the processed data.

In some implementations, the processed data is used to determine thesubject's compliance with a particular standard of care throughout aprogression of steps of the standard of care.

In some implementations, the processed data is used to determine whetherthe subject is receiving care that is appropriate according to aparticular standard of care.

In some implementations, the risk includes overexposure of the subjectto ultraviolet light.

In some implementations, the device also includes an ultraviolet lightsensor configured to measure an amount of ultraviolet light that thesubject is exposed to.

In some implementations, the processor is also configured to processdata that represents information about the amount of ultraviolet lightthat the subject is exposed to.

In some implementations, the processor is also configured to compare theamount of ultraviolet light that the subject is exposed to a thresholdto determine whether the subject has been overexposed to ultravioletlight.

In some implementations, the device is also configured to alert thesubject if the subject has been overexposed to ultraviolet light.

In another aspect, a method includes processing data in a first datasetthat represents time-varying information about at least one pulsepressure wave propagating through blood in a subject acquired at alocation of the subject. The method also includes providing informationrelated to the data to a remote device.

In another aspect, a system includes a remote device and a biofeedbackdevice configured to be worn by a subject. The biofeedback deviceincludes a light source configured to emit light toward the skin of thesubject. The biofeedback device also includes an optical sensorconfigured to receive the emitted light after the emitted light reflectsoff of the skin of the subject. The optical sensor is also configured toprovide data that corresponds to a characteristic of the received light,the data representing time-varying information about at least one pulsepressure wave propagating through blood in the subject acquired by theoptical sensor at a location of the subject. The biofeedback device alsoincludes a processor configured to receive data from one or both of thelight-emitting element and the optical sensor. The processor is alsoconfigured to provide information related to the data to a remotedevice.

In another aspect, one or more machine-readable storage devices storesinstructions that are executable by one or more processing devices toperform operations including processing data in a first dataset thatrepresents time-varying information about at least one pulse pressurewave propagating through blood in a subject acquired at a location ofthe subject. The operations also include providing information relatedto the data to a remote device.

In another aspect, a biofeedback device configured to be worn by asubject includes a light source configured to emit light toward the skinof the subject. The biofeedback device also includes an optical sensorconfigured to receive the emitted light after the emitted light reflectsoff of the skin of the subject. The optical sensor is also configured toprovide data that corresponds to a characteristic of the received light,the data representing time-varying information about at least one pulsepressure wave propagating through blood in the subject acquired by theoptical sensor at a location of the subject. The biofeedback device alsoincludes a processor configured to receive data from one or both of thelight-emitting element and the optical sensor. The processor is alsoconfigured to provide information related to the data to a remotedevice.

Implementations can include one or more of the following features.

In some implementations, the method also includes processing data in asecond dataset that represents time-varying information about motion ofthe subject acquired at the location of the subject.

In some implementations, the information about at least one pulsepressure wave propagating through blood in the subject includesphotoplethysmographic (PPG) data and the information about motion of thesubject includes one or both of motioncardiogram (MoCG) data and grossmotion data.

In some implementations, the data is acquired continuously.

In some implementations, the data is acquired at a frequency of at least16 Hz.

In some implementations, the data is acquired at a frequency of between75 Hz and 85 Hz.

In some implementations, the data is acquired at a single location ofthe subject.

In some implementations, the data is acquired by a device worn by thesubject.

In some implementations, the device is mobile and does not reduce amobility of the subject.

In some implementations, the device processes the data.

In some implementations, the single location is an arm of the subject.

In some implementations, the single location is a wrist of the subject.

In some implementations, the remote device is a server.

In some implementations, the method also includes determining, based onthe data in the first and second datasets, that the subject isexperiencing or has experienced a health-related problem.

In some implementations, the method also includes causing the remotedevice to alert one or both of a caregiver and the subject that thesubject is experiencing or has experienced a health-related problem.

In some implementations, the method also includes causing the remotedevice to alert the subject that the subject is experiencing ahealth-related problem.

In some implementations, the remote device sends an alert to a deviceworn by the subject that acquires the data.

In some implementations, the remote device sends an alert to a mobilephone of the subject.

In some implementations, determining that the subject is experiencing orhas experienced a health-related problem includes determining whether ablood pressure of the subject satisfies a threshold.

In some implementations, wherein the health-related problem ishypertension.

In some implementations, determining that the subject is experiencing orhas experienced a health-related problem includes determining a rate ofchange of a blood pressure of the subject.

In some implementations, the medical event is a stroke, and the subjectis determined to be having a stroke if the rate of change of the bloodpressure of the subject is positive and above a threshold.

In some implementations, the medical event is abnormal heart function,and the subject is determined to be experiencing abnormal heart functionif the rate of change of the blood pressure of the subject is negativeand below a threshold.

In some implementations, the method also includes identifying a firstpoint in the first dataset, the first point representing an arrival timeof the pulse pressure wave at a first body part of the subject. Themethod also includes identifying a second point in the second dataset,the second point representing an earlier time at which the pulsepressure wave traverses a second body part of the subject. The methodalso includes computing a pulse transit time (PTT) as a differencebetween the first and second points, the PTT representing a time takenby the pulse pressure wave to travel from the second body part to thefirst body part of the subject.

In some implementations, the blood pressure of the subject is determinedbased on the PTT.

In some implementations, the first body part is the location of thesubject at which the data in the first data set is acquired, and thesecond body part is the heart of the subject.

In some implementations, determining that the subject is experiencing ahealth-related problem includes determining whether a heart rate of thesubject satisfies a threshold.

In some implementations, the health-related problem is tachycardia.

In some implementations, determining the heart rate of the subjectincludes calculating a distance between two consecutive reference pointsin the first dataset, the distance representing a time that has elapsedbetween two consecutive heartbeats of the subject.

In some implementations, the reference points are local maxima or localminima.

In some implementations, the reference points are peaks or valleys inthe first dataset.

In some implementations, determining that the subject is experiencing ahealth-related problem includes determining whether a heart ratevariability of the subject satisfies a threshold.

In some implementations, the threshold is based on whether the subjectexperiences arrhythmia.

In some implementations, determining the heart rate variability of thesubject includes calculating distances between multiple pairs ofconsecutive reference points in the first dataset, each distancerepresenting a time that has elapsed between two consecutive heartbeatsof the subject.

In some implementations, the reference points are local maxima or localminima.

In some implementations, the reference points are peaks or valleys.

In some implementations, determining that the subject has experienced ahealth-related problem includes determining whether the subject hassustained an impact of a magnitude that satisfies a threshold.

In some implementations, determining the magnitude of the impactincludes analyzing gross motion data of the subject at the time of theimpact.

In some implementations, the health-related problem is a concussion.

In some implementations, the method also includes determining, based onthe data in the first and second datasets, that the subject is about toexperience a health-related problem.

In some implementations, the method also includes causing the remotedevice to alert a caregiver that the subject is about to experience ahealth-related problem.

In some implementations, the method also includes causing the remotedevice to alert the subject that the subject is about to experience ahealth-related problem.

In some implementations, the remote device sends an alert to a deviceworn by the subject that acquires the data.

In some implementations, the remote device sends an alert to a mobilephone of the subject.

In some implementations, determining that the subject is about toexperience a health-related problem includes determining whether a bloodpressure of the subject satisfies a threshold.

In some implementations, the method also includes identifying a firstpoint in the first dataset, the first point representing an arrival timeof the pulse pressure wave at a first body part of the subject. Themethod also includes identifying a second point in the second dataset,the second point representing an earlier time at which the pulsepressure wave traverses a second body part of the subject. The methodalso includes computing a pulse transit time (PTT) as a differencebetween the first and second points, the PTT representing a time takenby the pulse pressure wave to travel from the second body part to thefirst body part of the subject.

In some implementations, the blood pressure of the subject is determinedbased on the PTT.

In some implementations, the first body part is the location of thesubject at which the data in the first data set is acquired, and thesecond body part is the heart of the subject.

In some implementations, determining that the subject is about toexperience a health-related problem includes determining whether a heartrate of the subject satisfies a threshold.

In some implementations, determining the heart rate of the subjectincludes calculating a distance between two consecutive reference pointsin the first dataset, the distance representing a time that has elapsedbetween two consecutive heartbeats of the subject.

In some implementations, the reference points are local maxima or localminima.

In some implementations, the reference points are peaks or valleys inthe first dataset.

In some implementations, determining that the subject is about toexperience a health-related problem includes determining whether a heartrate variability of the subject satisfies a threshold.

In some implementations, determining the heart rate variability of thesubject includes calculating distances between multiple pairs ofconsecutive reference points in the first dataset, each distancerepresenting a time that has elapsed between two consecutive heartbeatsof the subject.

In some implementations, the reference points are local maxima or localminima.

In some implementations, the reference points are peaks or valleys.

In some implementations, the method also includes providing locationinformation related to the subject to the remote device.

In some implementations, the location information is provided by alocation module of a device worn by the subject that acquires the data.

In some implementations, the location module is a GPS transponder.

In some implementations, the method also includes providing temperatureinformation related to the subject to the remote device.

In some implementations, the remote device is a thermostat.

In some implementations, the subject is remote from a location that istemperature-controlled by the thermostat.

In some implementations, the thermostat is configured to adjust itstemperature settings based on the temperature information related to thesubject.

In some implementations, a time when the thermostat adjusts itstemperature settings is based on the location information related to thesubject.

In some implementations, the thermostat adjusts its temperature settingswhen the location information indicates that the subject is within apredefined distance from a location that is temperature-controlled bythe thermostat.

In some implementations, the remote device is a light.

In some implementations, the subject is remote from a location that canbe illuminated by the light.

In some implementations, the light is configured to adjust its lightingsettings at a time that is based on the location information related tothe subject.

In some implementations, the light adjusts its lighting settings whenthe location information indicates that the subject is within apredefined distance from a location that is lighting-controlled by thelight.

In some implementations, the method also includes determining that thesubject is interacting with a particular object based on a location ofthe subject.

In some implementations, the remote device is a server.

In some implementations, the particular object is an advertisement.

In some implementations, the particular object is a product display.

In some implementations, the particular object is a retail product.

In some implementations, the location of the subject is determined by aGPS module of a device worn by the subject that acquires the data.

In some implementations, the location of the subject is determined basedon a strength of a wireless connection between a device worn by thesubject that acquires the data and one or more proximity sensors.

In some implementations, a relatively higher strength of the wirelessconnection between the device and the proximity sensor indicates thatthe device is relatively closer to the proximity sensor.

In some implementations, the wireless connection is a Bluetoothconnection.

In some implementations, the method also includes determining, based onthe processed data, that the subject is experiencing one or more of anincrease in heart rate, blood pressure, and respiratory rate while thesubject is interacting with the particular object.

In some implementations, the method also includes inferring that thesubject is interested in the particular object based on one or more ofthe heart rate, the blood pressure, and the respiratory rate of thesubject while the subject is interacting with the particular object.

In some implementations, the remote device is an entertainment device.

In some implementations, the entertainment device is a television.

In some implementations, the entertainment device is an audio outputdevice.

In some implementations, the entertainment device is a gaming device.

In some implementations, the processed data indicates whether thesubject has exercised for a predetermined length of time, and theentertainment device can be turned on only if the subject has exercisedfor the predetermined length of time.

In some implementations, the entertainment device is configured toprovide content personalized for the subject based on a state of thesubject as determined from the processed data.

In some implementations, the state of the subject includes a level ofinterest in the content provided by the entertainment device.

In some implementations, a rise in one or more of a heart rate, a heartrate variability, an electrical skin impedance, a respiratory rate, anda blood pressure of the subject while the subject is experiencing thecontent indicates an increased level of interest in the content.

In some implementations, the heart rate, the heart rate variability, theelectrical skin impedance, and the respiratory rate of the subject aredetermined from the processed data.

In some implementations, the method also includes processing data in asecond dataset that represents time-varying information about motion ofthe subject acquired at the location of the subject. The blood pressureof the subject is determined from the processed data.

In some implementations, the entertainment device provides contentdesigned to excite the subject if the heart rate variability of thesubject is within a predefined range.

In some implementations, the entertainment device provides contentdesigned to excite the subject if one or more of the heart rate, theelectrical skin impedance, the respiratory rate, and the blood pressureof the subject is below a respective threshold.

In some implementations, the state of the subject includes a level ofstress of the subject while the subject is experiencing the content.

In some implementations, a rise in one or more of a heart rate, a heartrate variability, an electrical skin impedance, a respiratory rate, anda blood pressure of the subject while the subject is experiencing thecontent indicates an increased level of interest in the content.

In some implementations, the heart rate, the heart rate variability, theelectrical skin impedance, and the respiratory rate of the subject aredetermined from the processed data.

In some implementations, the method also includes processing data in asecond dataset that represents time-varying information about motion ofthe subject acquired at the location of the subject, wherein the bloodpressure of the subject is determined from the processed data.

In some implementations, the entertainment device provides contentdesigned to calm the subject if the heart rate variability of thesubject is within a predefined range.

In some implementations, the entertainment device provides contentdesigned to calm the subject if one or more of the heart rate, theelectrical skin impedance, the respiratory rate, and the blood pressureof the subject is above a respective threshold.

In some implementations, the entertainment device is a television andthe content includes one or more of television shows, movies, and games.

In some implementations, the entertainment device is a gaming devicethat is configured to adjust game settings based on a state of thesubject as determined from the processed data.

In some implementations, game settings include one or more of difficultysettings, sound settings, and situational settings.

In some implementations, the entertainment device is configured to turnoff based on a state of the subject as determined from the processeddata.

In some implementations, the method also includes causing the remotedevice to adjust a dating preference in a dating profile of the subjectbased on a state of the subject as determined from the processed data.

In some implementations, the method also includes processing data thatrepresents time-varying information about at least one pulse pressurewave propagating through blood in one or more other subjects acquired atlocations on the other subjects. The method also includes processingdata that represents time-varying information about motion of the one ormore other subjects acquired at the locations on the other subjects. Themethod also includes determining a compatibility between the subject andeach of the other subjects based on states of the subjects as determinedfrom the data.

In some implementations, the method also includes ranking thecompatibilities between the subject and each of the other subjects.

In some implementations, the remote device is a device operated by thesubject.

In some implementations, the method also includes determining, based onthe data in the first and second datasets, that the subject is notadequately alert.

In some implementations, determining that the subject is not adequatelyalert is based on one or more of a heart rate, a respiratory rate, ablood pressure, and an activity level of the subject.

In some implementations, determining that the subject is not adequatelyalert includes determining, based on the processed data, whether one ormore of the heart rate, the respiratory rate, the blood pressure, andthe activity level of the subject is below a threshold.

In some implementations, the method also includes causing the device toactivate an alarm if the subject is not adequately alert.

In some implementations, the method also includes causing the device toslow down if the subject is not adequately alert.

In some implementations, the device is a vehicle.

In some implementations, the data is acquired by the device and thedevice is wearable by the subject.

In some implementations, the method also includes causing an alarm ofthe wearable device to be activated if the subject is not adequatelyalert.

In some implementations, the biofeedback device also includes a motionsensor configured to provide data that represents time-varyinginformation about motion of the subject acquired by the motion sensor atthe location of the subject. The processor is also configured to receivedata from the motion sensor.

In some implementations, the operations also include processing data ina second dataset that represents time-varying information about motionof the subject acquired at the location of the subject.

In some implementations, the biofeedback device also includes a motionsensor configured to provide data that represents time-varyinginformation about motion of the subject acquired by the motion sensor atthe location of the subject. The processor is also configured to receivedata from the motion sensor.

In some implementations, the processor is also configured to determine,based on the received data, that the subject is experiencing or hasexperienced a health-related problem.

In some implementations, the processor is also configured to determine,based on the received data, that the subject is about to experience ahealth-related problem.

In some implementations, the processor is also configured to cause theremote device to alert a caregiver that the subject is experiencing, hasexperienced, or is about to experience a health-related problem.

In some implementations, the processor is also configured to cause theremote device to alert the subject that the subject is experiencing, hasexperienced, or is about to experience a health-related problem.

In some implementations, the remote device sends an alert to thebiofeedback device.

In some implementations, the remote device sends an alert to a mobilephone of the subject.

In some implementations, the processor is also configured to providelocation information related to the subject to the remote device.

In some implementation, the biofeedback device also includes a locationmodule configured to provide the location information related to thesubject to the remote device.

In some implementations, the location module is a GPS transponder.

In some implementations, the processor is also configured to providetemperature information related to the subject to the remote device.

In some implementations, the processor is also configured to determinethat the subject is interacting with a particular object based on alocation of the subject.

In some implementations, the remote device is a server.

In some implementations, the particular object is an advertisement.

In some implementations, the particular object is a product display.

In some implementations, the particular object is a retail product.

In some implementations, the location of the subject is determined bythe GPS module of the biofeedback device.

In some implementations, the location of the subject is determined basedon a strength of a wireless connection between the biofeedback deviceand one or more proximity sensors.

In some implementations, a relatively higher strength of the wirelessconnection between the biofeedback device and the proximity sensorindicates that the biofeedback device is relatively closer to theproximity sensor.

In some implementations, the wireless connection is a Bluetoothconnection.

In some implementations, the remote device is a device operated by thesubject.

In some implementations, the processor is also configured to determine,based on the received data, that the subject is not adequately alert.

In some implementations, the processor is also configured to cause thebiofeedback device to activate an alarm if the subject is not adequatelyalert.

In some implementations, the processor is also configured to cause thedevice operated by the subject to slow down if the subject is notadequately alert.

In some implementations, the device is a vehicle.

In another aspect, a method includes deriving a score associated with astate of a subject, the state of the subject being one or more membersselected from the group consisting of health, sleep, fitness, andstress. Deriving the score is based on data in a first dataset thatrepresents time-varying information about at least one pulse pressurewave propagating through blood in the subject acquired at a location ofthe subject.

In another aspect, one or more machine-readable storage devices storesinstructions that are executable by one or more processing devices toperform operations including deriving a score associated with a state ofa subject. The state of the subject is one or more members selected fromthe group consisting of health, sleep, fitness, and stress. Deriving thescore is based on data in a first dataset that represents time-varyinginformation about at least one pulse pressure wave propagating throughblood in the subject acquired at a location of the subject.

In another aspect, a biofeedback device configured to be worn by asubject includes a light source configured to emit light toward the skinof the subject. The device also includes an optical sensor configured toreceive the emitted light after the emitted light reflects off of theskin of the subject. The optical sensor is also configured to providedata that corresponds to a characteristic of the received light, thedata representing time-varying information about at least one pulsepressure wave propagating through blood in the subject acquired by theoptical sensor at a location of the subject. The device also includes amotion sensor configured to provide data that represents time-varyinginformation about motion of the subject acquired by the motion sensor atthe location of the subject. The device also includes a processorconfigured to receive data from one or more of the light-emittingelement, the optical sensor, and the motion sensor. The processor isalso configured to derive a score associated with a state of thesubject, the state of the subject being one or more members selectedfrom the group consisting of health, sleep, fitness, and stress.

Implementations can include one or more of the following features.

In some implementations, deriving the score is also based on data in asecond dataset that represents time-varying information about motion ofthe subject acquired at the location of the subject.

In some implementations, the information about at least one pulsepressure wave propagating through blood in the subject includesphotoplethysmographic (PPG) data and the information about motion of thesubject includes one or both of motioncardiogram (MoCG) data and grossmotion data.

In some implementations, the data is acquired continuously.

In some implementations, the data is acquired at a frequency of at least16 Hz.

In some implementations, the data is acquired at a frequency of between75 Hz and 85 Hz.

In some implementations, the data is acquired at a single location ofthe subject.

In some implementations, the data is acquired by a device worn by thesubject.

In some implementations, the device is mobile and does not reduce amobility of the subject.

In some implementations, the device processes the data.

In some implementations, the single location is an arm of the subject.

In some implementations, the single location is a wrist of the subject.

In some implementations, the score is a numerical value.

In some implementations, the numerical value is between 1 and 100.

In some implementations, the numerical value is between 1 and 10.

In some implementations, the data is acquired by a device that is wornby the subject and that displays the score.

In some implementations, the device worn by the subject derives thescore.

In some implementations, the device worn by the subject provides thedata to a remote device that derives the score.

In some implementations, the remote device is a server.

In some implementations, the remote device provides the score to thedevice worn by the subject.

In some implementations, the remote device provides the score to amobile phone of the subject.

In some implementations, the score is provided to one or both of thesubject and another party.

In some implementations, the state of the subject includes a sleepstate, and the score includes a sleep score.

In some implementations, the sleep score is associated with a level ofquality of the subject's sleep.

In some implementations, deriving the score includes identifying one ormore potential sleep rest periods of the subject based on gross motiondata of the subject.

In some implementations, deriving the score also includes calculatingone or more of an average heart rate, a standard deviation of theaverage heart rate, and an average heart rate variability of the subjectduring each of the one or more potential sleep rest periods based on theinformation about at least one pulse pressure wave propagating throughblood in the subject.

In some implementations, one or more of the potential sleep rest periodsare identified as sleep rest periods by comparing one or more of theaverage heart rate, the standard deviation of the average heart rate,and the average heart rate variability of the subject during therespective potential sleep rest period to a threshold.

In some implementations, the sleep state of the subject is associatedwith one or more of sleep duration, sleep latency, and sleep staging.

In some implementations, deriving the score includes determining one ormore of the sleep duration, the sleep latency, and the sleep staging ofthe subject.

In some implementations, the method also includes determining the sleepduration of the subject.

In some implementations, determining the sleep duration of the subjectincludes determining a total length of time during which the subject wasasleep based on information related to one or more sleep rest periods ofthe subject.

In some implementations, the information related to the one or moresleep rest periods includes a time associated with a beginning of eachsleep rest period, a time associated with an end of each sleep restperiod, gross motion data of the subject during each sleep rest period,and heart rate data of the subject during each sleep rest period.

In some implementations, determining the sleep duration of the subjectincludes determining a percentage of time that the subject was asleepbetween a time when the subject started to try to fall asleep and a timewhen the subject awoke based on information related to one or more sleeprest periods of the subject and gross motion data of the subject beforethe subject fell asleep.

In some implementations, the method also includes determining the sleeplatency of the subject.

In some implementations, determining the sleep latency of the subjectincludes determining a length of time that it takes for the subject totransition from a state of wakefulness to the sleep state based oninformation related to one or more sleep rest periods of the subject andgross motion data of the subject before the subject fell asleep.

In some implementations, the method also includes determining the sleepstaging of the subject.

In some implementations, determining the sleep staging of the subjectincludes determining a deepness of the subject's sleep during a portionof each of one or more sleep rest periods of the subject based oninformation related to the one or more sleep rest periods.

In some implementations, the sleep staging of the subject is determinedbased on at least a heart rate and gross motion data of the subjectduring one or more of the portions of the sleep rest periods.

In some implementations, the data is acquired by a device that is wornby the subject.

In some implementations, the method also includes causing the device tocalculate and display the sleep score when the subject is determined tohave awoken.

In some implementations, the method also includes providing informationto the subject that assists the subject in improving the sleep score.

In some implementations, the information includes a recommended sleepschedule.

In some implementations, the information is provided to a device that isworn by the subject that acquires the data.

In some implementations, the information is provided to a mobile phoneof the subject.

In some implementations, the state of the subject includes a fitnessstate, and the score includes a fitness score.

In some implementations, the fitness score is associated with one ormore of a degree of physical fitness, cardiac condition, coaching,dehydration, social interaction, adherence to a regimen, and coachingeffectiveness of the subject.

In some implementations, deriving the score includes calculating aresting heart rate of the subject while the subject is inactive based onthe information about at least one pulse pressure wave propagatingthrough blood in the subject and gross motion data of the subject.

In some implementations, deriving the score also includes calculating aheart rate of the subject based on the information about at least onepulse pressure wave propagating through blood in the subject. Derivingthe score also includes determining that the subject is in the fitnessstate based on the heart rate and the gross motion data of the subject.

In some implementations, deriving the score includes determining alength of time that it takes for the subject's heart rate to transitionfrom the heart rate in the fitness state to the resting heart rate.

In some implementations, deriving the score includes determining alength of time that it takes for the subject's heart rate to transitionfrom the resting heart rate to the heart rate in the fitness state.

In some implementations, the data is acquired by a device that is wornby the subject.

In some implementations, the method also includes causing the device tocalculate and display the fitness score when the subject is determinedto be in the fitness state.

In some implementations, the method also includes causing the device tocalculate and display the fitness score when the subject is determinedto have transitioned from the fitness state to a non-fitness state.

In some implementations, the method also includes providing informationto the subject that assists the subject in improving the fitness score.

In some implementations, the information includes a recommended fitnessroutine.

In some implementations, the information is provided to a device that isworn by the subject that acquires the data.

In some implementations, the information is provided to a mobile phoneof the subject.

In some implementations, the method also includes embedding a visualindication of one or more of the fitness score, a heart rate, arespiratory rate, and a blood pressure of the subject into a videoshowing the subject performing a fitness routine.

In some implementations, the visual indications are updated throughoutthe video according to the fitness score, the heart rate, therespiratory rate, and the blood pressure of the subject during thefitness routine.

In some implementations, the method also includes predicting an outcomeof an athletic event that the subject is participating in based on oneor more of the fitness score, a heart rate, a respiratory rate, and ablood pressure of the subject during the athletic event.

In some implementations, the method also includes comparing one or moreof the fitness score, the heart rate, the respiratory rate, and theblood pressure of the subject to fitness scores, heart rates,respiratory rates, and blood pressures of other individuals who areparticipating in the athletic event.

In some implementations, the method also includes, while the subject isperforming physical activity, comparing one or more of the fitnessscore, a heart rate, a respiratory rate, and a blood pressure of thesubject to fitness scores, heart rates, respiratory rates, and bloodpressures of one or more individuals who have previously performed thephysical activity.

In some implementations, performing the physical activity includesperforming an athletic event, and the one or more individuals areprofessional athletes who compete in the athletic event.

In some implementations, the state of the subject includes a stressstate, and the score includes a stress score.

In some implementations, deriving the score includes calculating one ormore of a heart rate, a heart rate variability, a blood pressure, anelectrical skin impedance, and a respiratory rate of the subject basedon the information about at least one pulse pressure wave propagatingthrough blood in the subject and information about motion of thesubject.

In some implementations, the stress state of the subject is associatedwith hypertension, and deriving the score includes determining whetherthe subject is experiencing hypertension by comparing a blood pressureof the subject to a threshold.

In some implementations, the stress state of the subject is associatedwith emotional stress, and deriving the score includes determining alevel of emotional stress experienced by the subject by comparing one ormore of a heart rate, a heart rate variability, a blood pressure, anelectrical skin impedance, and a respiratory rate of the subject to athreshold.

In some implementations, determining the level of emotional stressexperienced by the subject is based at least in part on audio data.

In some implementations, the audio data is captured by a microphone of adevice that acquires the data in the first dataset.

In some implementations, the audio data includes one or both ofenvironmental noise and a tonality of the subject's voice.

In some implementations, determining the level of emotional stressexperienced by the subject includes analyzing the environmental noise todetermine whether the subject is in an environment attributed to anincreased emotional stress level.

In some implementations, determining the level of emotional stressexperienced by the subject includes analyzing the tonality of thesubject's voice to determine whether the subject is in a confrontationalsituation attributed to an increased emotional stress level.

In some implementations, the data is acquired by a device that is wornby the subject.

In some implementations, the method also includes causing the device tocalculate and display the stress score when the subject is determined tobe in the stress state.

In some implementations, the method also includes providing informationto the subject that assists the subject in improving the stress score.

In some implementations, the information includes a recommendedstress-reducing routine.

In some implementations, the information is provided to a device that isworn by the subject that acquires the data.

In some implementations, the information is provided to a mobile phoneof the subject.

In some implementations, the state of the subject includes a sleepstate, and the score includes a sleep score.

In some implementations, the sleep state of the subject is associatedwith one or more of sleep duration, sleep latency, and sleep staging,and deriving the score includes determining one or more of the sleepduration, the sleep latency, and the sleep staging of the subject.

In some implementations, the processor is also configured to determinethe sleep duration of the subject.

In some implementations, determining the sleep duration of the subjectincludes determining a total length of time during which the subject wasasleep based on information related to one or more sleep rest periods ofthe subject.

In some implementations, determining the sleep duration of the subjectincludes determining a percentage of time that the subject was asleepbetween a time when the subject started to try to fall asleep and a timewhen the subject awoke based on information related to one or more sleeprest periods of the subject and gross motion data of the subject beforethe subject fell asleep.

In some implementations, the processor is also configured to determinethe sleep latency of the subject.

In some implementations, determining the sleep latency of the subjectincludes determining a length of time that it takes for the subject totransition from a state of wakefulness to the sleep state based oninformation related to one or more sleep rest periods of the subject andgross motion data of the subject before the subject fell asleep.

In some implementations, the processor is also configured to determinethe sleep staging of the subject.

In some implementations, determining the sleep staging of the subjectincludes determining a deepness of the subject's sleep during a portionof each of one or more sleep rest periods of the subject based oninformation related to the one or more sleep rest periods.

In some implementations, the sleep staging of the subject is determinedbased on at least a heart rate and gross motion data of the subjectduring one or more of the portions of the sleep rest periods.

In some implementations, the biofeedback device also includes a display,and the processor is also configured to cause the display to display thesleep score.

In some implementations, the processor causes the display to display thesleep score when the subject is determined to have awoken.

In some implementations, the state of the subject includes a fitnessstate, and the score includes a fitness score.

In some implementations, the fitness score is associated with one ormore of a degree of physical fitness, cardiac condition, coaching,dehydration, social interaction, adherence to a regimen, and coachingeffectiveness of the subject.

In some implementations, deriving the score includes calculating aresting heart rate of the subject while the subject is inactive based onthe information about at least one pulse pressure wave propagatingthrough blood in the subject and gross motion data of the subject.

In some implementations, deriving the score also includes calculating aheart rate of the subject based on the information about at least onepulse pressure wave propagating through blood in the subject. Derivingthe score also includes determining that the subject is in the fitnessstate based on the heart rate and the gross motion data of the subject.

In some implementations, deriving the score also includes determining alength of time that it takes for the subject's heart rate to transitionfrom the heart rate in the fitness state to the resting heart rate.

In some implementations, deriving the score also includes determining alength of time that it takes for the subject's heart rate to transitionfrom the resting heart rate to the heart rate in the fitness state.

In some implementations, the processor is also configured to cause thedisplay to display the fitness score.

In some implementations, the processor causes the display to display thefitness score when the subject is determined to be in the fitness state.

In some implementations, the processor causes the display to display thefitness score when the subject is determined to have transitioned fromthe fitness state to a non-fitness state.

In some implementations, the processor is also configured to determineone or more of a heart rate, a respiratory rate, and a blood pressure ofthe subject based on data received from one or more of thelight-emitting element, the optical sensor, and the motion sensor.

In some implementations, the device also includes a transceiver, and theprocessor is configured to cause the transceiver to provide one or moreof the fitness score, the heart rate, the respiratory rate, and theblood pressure of the subject to a remote device.

In some implementations, the processor causes the transceiver to provideone or more of the fitness score, the heart rate, the respiratory rate,and the blood pressure of the subject to a video that shows the subjectperforming a fitness routine. A visual indication of one or more of thefitness score, the heart rate, the respiratory rate, and the bloodpressure of the subject is embedded into the video.

In some implementations, the visual indications are updated throughoutthe video according to the fitness score, the heart rate, therespiratory rate, and the blood pressure of the subject during thefitness routine.

In some implementations, the processor is also configured to predict anoutcome of an athletic event that the subject is participating in basedon one or more of the fitness score, the heart rate, the respiratoryrate, and the blood pressure of the subject during the athletic event.

In some implementations, the transceiver is configured to communicatewith transceivers of other biofeedback devices.

In some implementations, the processor is also configured to compare oneor more of the fitness score, the heart rate, the respiratory rate, andthe blood pressure of the subject to fitness scores, heart rates,respiratory rates, and blood pressures of other individuals who areparticipating in the athletic event.

In some implementations, the processor is also configured to, while thesubject is performing physical activity, compare one or more of thefitness score, the heart rate, the respiratory rate, and the bloodpressure of the subject to fitness scores, heart rates, respiratoryrates, and blood pressures of one or more individuals who havepreviously performed the physical activity.

In some implementations, performing the physical activity includesperforming an athletic event, and the one or more individuals areprofessional athletes who compete in the athletic event.

In some implementations, the state of the subject includes a stressstate, and the score includes a stress score.

In some implementations, the stress state of the subject is associatedwith emotional stress, and deriving the score includes determining alevel of emotional stress experienced by the subject by comparing one ormore of a heart rate, a heart rate variability, a blood pressure, anelectrical skin impedance, and a respiratory rate of the subject to athreshold.

In some implementations, the biofeedback device also includes an audioinput device.

In some implementations, determining the level of emotional stressexperienced by the subject is based at least in part on audio dataprovided to the processor by the audio input device.

In some implementations, the audio data includes one or both ofenvironmental noise and a tonality of the subject's voice.

In some implementations, determining the level of emotional stressexperienced by the subject includes analyzing the environmental noise todetermine whether the subject is in an environment attributed to anincreased emotional stress level

In some implementations, determining the level of emotional stressexperienced by the subject includes analyzing the tonality of thesubject's voice to determine whether the subject is in a confrontationalsituation attributed to an increased emotional stress level.

In some implementations, the processor is also configured to cause thedisplay to display the stress score.

In some implementations, the processor causes the display to display thestress score when the subject is determined to be in the stress state.

In another aspect, a method includes processing data in a first datasetthat represents time-varying information about at least one pulsepressure wave propagating through blood in a subject acquired at alocation of the subject. The method also includes processing data in asecond dataset that represents time-varying information about motion ofthe subject acquired at the location of the subject. The method alsoincludes deriving information about a psychological state of the subjectfrom the processed data.

In another aspect, one or more machine-readable storage devices storesinstructions that are executable by one or more processing devices toperform operations including processing data in a first dataset thatrepresents time-varying information about at least one pulse pressurewave propagating through blood in a subject acquired at a location ofthe subject. The operations also include processing data in a seconddataset that represents time-varying information about motion of thesubject acquired at the location of the subject. The operations alsoinclude deriving information about a psychological state of the subjectfrom the processed data.

In another aspect, a biofeedback device configured to be worn by asubject includes a light source configured to emit light toward the skinof the subject. The device also includes an optical sensor configured toreceive the emitted light after the emitted light reflects off of theskin of the subject. The optical sensor is also configured to providedata that corresponds to a characteristic of the received light, thedata representing time-varying information about at least one pulsepressure wave propagating through blood in the subject acquired by theoptical sensor at a location of the subject. The device also includes amotion sensor configured to provide data that represents time-varyinginformation about motion of the subject acquired by the motion sensor atthe location of the subject. The device also includes a processorconfigured to receive data from one or more of the light-emittingelement, the optical sensor, and the motion sensor. The processor isalso configured to derive information about a psychological state of thesubject from the processed data.

Implementations can include one or more of the following features.

In some implementations, the information about at least one pulsepressure wave propagating through blood in the subject includesphotoplethysmographic (PPG) data and the information about motion of thesubject includes one or both of motioncardiogram (MoCG) data and grossmotion data.

In some implementations, the data is acquired continuously.

In some implementations, the data is acquired at a frequency of at least16 Hz.

In some implementations, the data is acquired at a frequency of between75 Hz and 85 Hz.

In some implementations, the data is acquired at a single location ofthe subject.

In some implementations, the data is acquired by a device worn by thesubject.

In some implementations, the device is mobile and does not reduce amobility of the subject.

In some implementations, the device processes the data.

In some implementations, the single location is an arm of the subject.

In some implementations, the single location is a wrist of the subject.

In some implementations, the psychological state of the subject includesa state of stress.

In some implementations, the method also includes determining one ormore of a blood pressure, a heart rate, and a heart rate variability ofthe subject based on the datasets. The method also includes derivinginformation about the state of stress of the subject based on one ormore of the determined blood pressure, heart rate, and heart ratevariability of the subject.

In some implementations, the method also includes correlating a level ofstress of the subject to an amount of ultraviolet light that the subjecthas been exposed to.

In some implementations, deriving the information includes inferring arelationship between at least some of the processed data and onepsychological state of the subject.

In some implementations, the method also includes inferring an existenceof a second psychological state of the subject by comparing otherprocessed data with the processed data related to the one psychologicalstate.

In some implementations, the one psychological state includes a state ofrelatively lower stress.

In some implementations, the one psychological state includes a baselinestate of the subject, and the relationship between at least some of theprocessed data and the one psychological state is inferred prior to thesubject performing a polygraph test.

In some implementations, the psychological state includes a maliciousintent.

In some implementations, the psychological state includes lying.

In some implementations, a device worn by the subject acquires the data.

In some implementations, deriving information about the psychologicalstate of the subject includes determining a baseline state of thesubject based on one or more of a blood pressure, a heart rate, a heartrate variability, a respiratory rate, and an electrical skin impedance.

In some implementations, the device is worn by the subject for anextended period of time to determine the baseline state of the subject.

In some implementations, the device is continuously worn by the subjectfor more than one day.

In some implementations, the processor is also configured to determineone or more of a blood pressure, a heart rate, and a heart ratevariability of the subject based on the received data. The processor isalso configured to derive information about a state of stress of thesubject based on one or more of the determined blood pressure, heartrate, and heart rate variability of the subject.

In some implementations, the device also includes an ultraviolet lightsensor configured to measure an amount of ultraviolet light that thesubject is exposed to.

In some implementations, the processor is also configured to correlate alevel of stress of the subject to an amount of ultraviolet light thatthe subject has been exposed to.

In another aspect, a method includes processing data in a dataset thatrepresents time-varying information about at least one pulse pressurewave propagating through blood in a subject acquired at a location ofthe subject. The method also includes determining whether one or moresegments of the dataset were captured from a subject other than anexpected subject by analyzing morphological features of the segments.

In another aspect, a method includes processing data in a dataset thatrepresents time-varying information about motion of a subject acquiredat a location of the subject. The method also includes determiningwhether one or more segments of the dataset were captured from a subjectother than an expected subject by analyzing morphological features ofthe segments.

In another aspect, a method includes processing data in a first datasetthat represents time-varying information about at least one pulsepressure wave propagating through blood in a subject acquired at alocation of the subject. The method also includes processing data in asecond dataset that represents time-varying information about motion ofthe subject acquired at the location of the subject. The method alsoincludes, based on the first and second datasets, determining at leasttwo parameters of the subject, the parameters selected from the groupconsisting of blood pressure, respiratory rate, blood oxygen levels,heart rate, heart rate variability, stroke volume, cardiac output, MoCGmorphology, and PPG morphology. The method also includes determining abiometric signature of the subject, the biometric signature representedby a multi-dimensional space that is defined by at least two axes, eachaxis corresponding to at least one of the determined parameters. Themethod also includes determining whether the biometric signature wascaptured from a subject who is an expected subject by analyzing featuresof the biometric signature.

In another aspect, one or more machine-readable storage devices storesinstructions that are executable by one or more processing devices toperform operations including processing data in a dataset thatrepresents time-varying information about at least one pulse pressurewave propagating through blood in a subject acquired at a location ofthe subject. The operations also include determining whether one or moresegments of the dataset were captured from a subject other than anexpected subject by analyzing morphological features of the segments.

In another aspect, one or more machine-readable storage devices storesinstructions that are executable by one or more processing devices toperform operations including processing data in a dataset thatrepresents time-varying information about motion of a subject acquiredat a location of the subject. The operations also include determiningwhether one or more segments of the dataset were captured from a subjectother than an expected subject by analyzing morphological features ofthe segments.

In another aspect, one or more machine-readable storage devices storesinstructions that are executable by one or more processing devices toperform operations including processing data in a first dataset thatrepresents time-varying information about at least one pulse pressurewave propagating through blood in a subject acquired at a location ofthe subject. The operations also include processing data in a seconddataset that represents time-varying information about motion of thesubject acquired at the location of the subject. The operations alsoinclude determining at least two parameters of the subject based on thefirst and second datasets. The parameters are selected from the groupconsisting of blood pressure, respiratory rate, blood oxygen levels,heart rate, heart rate variability, stroke volume, cardiac output, MoCGmorphology, and PPG morphology. The operations also include determininga biometric signature of the subject. The biometric signature isrepresented by a multi-dimensional space that is defined by at least twoaxes. Each axis corresponds to at least one of the determinedparameters. The operations also include determining whether thebiometric signature was captured from a subject who is an expectedsubject by analyzing features of the biometric signature.

In another aspect, a biofeedback device configured to be worn by asubject includes a light source configured to emit light toward the skinof the subject. The biofeedback device also includes an optical sensorconfigured to receive the emitted light after the emitted light reflectsoff of the skin of the subject. The optical sensor is also configured toprovide data that corresponds to a characteristic of the received light,the data representing time-varying information about at least one pulsepressure wave propagating through blood in the subject acquired by theoptical sensor at a location of the subject. The biofeedback device alsoincludes a processor configured to receive data from one or both of thelight-emitting element and the optical sensor. The processor is alsoconfigured to determine whether one or more segments of the data werecaptured from a subject other than an expected subject by analyzingmorphological features of the segments.

Implementations can include one or more of the following features.

In some implementations, the data is acquired continuously.

In some implementations, the data is acquired at a frequency of at least16 Hz.

In some implementations, the data is acquired at a frequency of between75 Hz and 85 Hz.

In some implementations, the data is acquired at a single location ofthe subject.

In some implementations, the data is acquired by a device worn by thesubject.

In some implementations, the device is mobile and does not reduce amobility of the subject.

In some implementations, the device processes the data.

In some implementations, the single location is an arm of the subject.

In some implementations, the single location is a wrist of the subject.

In some implementations, the determining includes analyzing otherbiometric data.

In some implementations, the other biometric data includes one or moreof electrical skin impedance, respiratory rate, heart rate, heart ratevariability, PPG morphology, and vocal sound frequency of the subject.

In some implementations, analyzing the other biometric data includesdetermining whether the subject is under distress.

In some implementations, the determining includes analyzing confidentialinformation provided by the subject.

In some implementations, the confidential information includes one ormore of a password, a personal identification number, and a predefinedgesture.

In some implementations, the analyzing includes comparing morphologicalfeatures of different segments of biometric data.

In some implementations, the method also includes taking an action whenit is determined that one or more of the segments were captured from asubject other than the expected subject.

In some implementations, taking an action includes prompting the subjectto provide confidential information to authenticate the subject as theexpected subject.

In some implementations, the expected subject is a subject associatedwith a particular device that captures the data segments at a locationon the expected subject.

In some implementations, the determining includes taking account of oneor both of a changing level of activity and a changing heart rate of thesubject.

In some implementations, the method also includes sending information toa device upon determining that the subject is the expected subject.

In some implementations, the device is a payment gateway, and theinformation includes a payment authorization.

In some implementations, the device is a lock, and the informationcauses a lock to unlock.

In some implementations, causing the lock to unlock is also based on alocation of the subject.

In some implementations, the method also includes sending information toa device upon determining that the subject is under distress.

In some implementations, the subject is determined to be under distressif one or more of a heart rate, a blood pressure, and a respiratory rateof the subject surpasses a threshold.

In some implementations, the device is a payment gateway, and theinformation includes instructions for the payment gateway to prevent thesubject from accessing the payment gateway.

In some implementations, the device is a lock, and the informationincludes instructions for the lock to remain locked.

In some implementations, the method also includes processing data in asecond dataset that represents time-varying information about motion ofthe subject acquired at the location of the subject. The method alsoincludes determining whether one or more segments of the datasets werecaptured from a subject other than an expected subject by analyzingmorphological features of the segments.

In some implementations, the information about at least one pulsepressure wave propagating through blood in the subject includesphotoplethysmographic (PPG) data and the information about motion of thesubject includes one or both of motioncardiogram (MoCG) data and grossmotion data.

In some implementations, the method also includes determining a pulsetransit time (PTT) based on the datasets, the PTT representing a transittime of a pulse pressure wave within the subject.

In some implementations, the method also includes determining a bloodpressure of the subject based on the datasets.

In some implementations, the determining includes analyzing otherbiometric data.

In some implementations, the other biometric data includes one or moreof electrical skin impedance, respiratory rate, heart rate, heart ratevariability, stroke volume, cardiac output, MoCG morphology, PPGmorphology, and vocal sound frequency of the subject.

In some implementations, analyzing the other biometric data includesdetermining whether the subject is under distress.

In some implementations, the morphological features include differencesin blood pressure at specific times during each of the data segments.

In some implementations, the specific times include times of peaks orvalleys in blood pressure during the data segments.

In some implementations, the morphological features include differencesin blood pressure at successive peaks of blood pressure, successivevalleys of blood pressure, or successive peaks and valleys of bloodpressure.

In some implementations, determining whether one or more segments of thedata were captured from a subject other than an expected subjectincludes analyzing confidential information provided by the subject.

In some implementations, the confidential information includes one ormore of a password, a personal identification number, and a predefinedgesture.

In some implementations, the biofeedback device also includes a motionsensor configured to provide data that represents time-varyinginformation about motion of the subject acquired by the motion sensor atthe location of the subject. The processor is also configured to receivedata from the motion sensor

In some implementations, the processor is also configured to take anaction when it is determined that one or more of the segments werecaptured from a subject other than the expected subject.

In some implementations, taking an action includes prompting the subjectto provide confidential information to authenticate the subject as theexpected subject.

In some implementations, the motion sensor is also configured todetermine when a subject performs the predefined gesture.

In some implementations, the biofeedback device also includes atransceiver configured to send information to a device upon determiningthat the subject is the expected subject.

In some implementations, the device is a payment gateway, and theinformation includes a payment authorization.

In some implementations, the device is a lock, and the informationcauses a lock to unlock.

In some implementations, the biofeedback device also includes a locationmodule, and causing the lock to unlock is also based on a location ofthe subject as determined by the location module.

In some implementations, the transceiver is also configured to sendinformation to a device upon determining that the subject is underdistress.

In some implementations, the device is a payment gateway, and theinformation includes instructions for the payment gateway to prevent thesubject from accessing the payment gateway.

In some implementations, the device is a lock, and the informationincludes instructions for the lock to remain locked.

In another aspect, a method includes processing data in a first datasetthat represents time-varying information about at least one pulsepressure wave propagating through blood in a subject acquired at alocation of the subject. The method also includes providing, based onthe data, information about a medication regimen of the subject.

In another aspect, one or more machine-readable storage devices storesinstructions that are executable by one or more processing devices toperform operations including processing data in a first dataset thatrepresents time-varying information about at least one pulse pressurewave propagating through blood in a subject acquired at a location ofthe subject. The operations also include providing, based on the data,information about a medication regimen of the subject.

In another aspect, a biofeedback device configured to be worn by asubject includes a light source configured to emit light toward the skinof the subject. The device also includes an optical sensor configured toreceive the emitted light after the emitted light reflects off of theskin of the subject. The optical sensor is also configured to providedata that corresponds to a characteristic of the received light, thedata representing time-varying information about at least one pulsepressure wave propagating through blood in the subject acquired by theoptical sensor at a location of the subject. The device also includes aprocessor configured to receive data from one or both of thelight-emitting element and the optical sensor. The processor is alsoconfigured to provide, based on the data, information about a medicationregimen of the subject.

Implementations can include one or more of the following features.

In some implementations, the method also includes processing data in asecond dataset that represents time-varying information about motion ofthe subject acquired at the location of the subject.

In some implementations, the information about at least one pulsepressure wave propagating through blood in the subject includesphotoplethysmographic (PPG) data and the information about motion of thesubject includes one or both of motioncardiogram (MoCG) data and grossmotion data.

In some implementations, the data is acquired continuously.

In some implementations, the data is acquired at a frequency of at least16 Hz.

In some implementations, the data is acquired at a frequency of between75 Hz and 85 Hz.

In some implementations, the data is acquired at a single location ofthe subject.

In some implementations, the data is acquired by a device worn by thesubject.

In some implementations, the device is mobile and does not reduce amobility of the subject.

In some implementations, the device processes the data.

In some implementations, the single location is an arm of the subject.

In some implementations, the single location is a wrist of the subject.

In some implementations, the method also includes determining, based onthe data, that the subject has potentially missed a dose of amedication. The method also includes providing a notification indicatingthat the subject has potentially missed the dose of the medication.

In some implementations, determining that the subject has potentiallymissed a dose of a medication includes determining that a blood pressureof the subject has crossed a threshold.

In some implementations, the method also includes identifying a firstpoint in the first dataset, the first point representing an arrival timeof the pulse pressure wave at a first body part of the subject. Themethod also includes identifying a second point in the second dataset,the second point representing an earlier time at which the pulsepressure wave traverses a second body part of the subject. The methodalso includes computing a pulse transit time (PTT) as a differencebetween the first and second points, the PTT representing a time takenby the pulse pressure wave to travel from the second body part to thefirst body part of the subject. The blood pressure of the subject isdetermined based on the PTT.

In some implementations, the first body part is the location of thesubject at which the data in the first data set is acquired, and thesecond body part is the heart of the subject.

In some implementations, determining that the subject has potentiallymissed a dose of a medication includes determining that a heart rate ofthe subject has crossed a threshold.

In some implementations, determining that the subject has potentiallymissed a dose of a medication includes determining that a respiratoryrate of the subject has crossed a threshold.

In some implementations, the method also includes determining, based onthe data, a reaction of the subject to a medication. The method alsoincludes providing a recommended medication regimen of the medicationbased on the reaction of the subject to the medication.

In some implementations, the recommended medication regimen includes oneor more recommended dosage timings. The recommended medication regimenalso includes one or more recommended dosage amounts. Each of therecommended dosage amounts corresponds to one of the dosage timings.

In some implementations, determining a reaction of the subject to amedication includes determining a blood pressure of the subject.

In some implementations, the blood pressure of the subject is determinedperiodically.

In some implementations, the recommended dosage timings and amounts aredetermined so as to maintain a blood pressure of the subject within adefined range.

In some implementations, determining a reaction of the subject to amedication includes determining a heart rate of the subject.

In some implementations, the heart rate of the subject is determinedperiodically.

In some implementations, determining a reaction of the subject to amedication includes determining a regularity of a heart rate of thesubject.

In some implementations, the recommended dosage timings and amounts aredetermined so as to maintain a heart rate of the subject within adefined range.

In some implementations, determining a reaction of the subject to amedication includes determining a cardiac output of the subject.

In some implementations, the recommended dosage timings and amounts aredetermined so as to maintain a cardiac output of the subject within adefined range.

In some implementations, determining a reaction of the subject to amedication includes determining a temperature of the subject.

In some implementations, the recommended dosage timings and amounts aredetermined so as to maintain the temperature of the subject within adefined range.

In some implementations, the recommended dosage timings and amounts aredetermined so as to maintain a heart rate of the subject within adefined range.

In some implementations, determining a reaction of the subject to amedication includes determining a respiratory rate of the subject.

In some implementations, the respiratory rate of the subject isdetermined periodically.

In some implementations, the recommended dosage timings and amounts aredetermined so as to maintain a respiratory rate of the subject within adefined range.

In some implementations, the biofeedback device also includes a motionsensor configured to provide data that represents time-varyinginformation about motion of the subject acquired by the motion sensor atthe location of the subject. The processor is also configured to receivedata from the motion sensor.

In some implementations, the processor is also configured to determine,based on the data, that the subject has potentially missed a dose of amedication and provide a notification indicating that the subject haspotentially missed the dose of the medication.

In some implementations, the processor is also configured to determine,based on the data, a reaction of the subject to a medication and providea recommended medication regimen of the medication based on the reactionof the subject to the medication.

In some implementations, the recommended medication regimen includes oneor more recommended dosage timings. The recommended medication regimenalso includes one or more recommended dosage amounts, each of whichcorresponds to one of the dosage timings.

In some implementations, the operations also include processing data ina second dataset that represents time-varying information about motionof the subject acquired at the location of the subject

In another aspect, a method includes processing data that representstime-varying information about at least one pulse pressure wavepropagating through blood in each of two or more subjects acquired at alocation of each of the subjects. The method also includes processingdata that represents time-varying information about motion of the two ormore subjects acquired at the location on each of the subject. Themethod also includes providing information to a user that reportsrelative states of the subjects.

In another aspect, one or more machine-readable storage devices storesinstructions that are executable by one or more processing devices toperform operations including processing data that representstime-varying information about at least one pulse pressure wavepropagating through blood in each of two or more subjects acquired at alocation of each of the subjects. The operations also include processingdata that represents time-varying information about motion of the two ormore subjects acquired at the location on each of the subject. Theoperations also include providing information to a user that reportsrelative states of the subjects.

In another aspect, a biofeedback device configured to be worn by two ormore subjects includes a light source configured to emit light towardthe skin of the subject. The device also includes an optical sensorconfigured to receive the emitted light after the emitted light reflectsoff of the skin of the subject. The optical sensor is also configured toprovide data that corresponds to a characteristic of the received light,the data representing time-varying information about at least one pulsepressure wave propagating through blood in the subject acquired by theoptical sensor at a location of the subject. The device also includes amotion sensor configured to provide data that represents time-varyinginformation about motion of the subject acquired by the motion sensor atthe location of the subject. The device also includes a processorconfigured to receive data from one or more of the light-emittingelement, the optical sensor, and the motion sensor. The processor isalso configured to provide information to a user that reports relativestates of the subjects.

Implementations can include one or more of the following features.

In some implementations, the information about at least one pulsepressure wave propagating through blood in the subjects includesphotoplethysmographic (PPG) data and the information about motion of thesubjects includes one or both of motioncardiogram (MoCG) data and grossmotion data.

In some implementations, the data is acquired continuously.

In some implementations, the data is acquired at a frequency of at least16 Hz.

In some implementations, the data is acquired at a frequency of between75 Hz and 85 Hz.

In some implementations, the data is acquired at single locations ofeach of the subjects.

In some implementations, the data is acquired by devices worn by thesubjects.

In some implementations, the devices are mobile and do not reducemobility of the subjects.

In some implementations, the devices process the data.

In some implementations, the single location of each of the subjects isan arm of the subject.

In some implementations, the single location is a wrist of the subject.

In some implementations, the relative states of the subjects aredetermined based on one or more of respiratory rates, heart rates, andblood pressures of the subjects.

In some implementations, the relative states of the subjects aredetermined by comparing one or more of the respiratory rates, the heartrates, and the blood pressures of the subjects to respective thresholdvalues.

In some implementations, devices worn by the subjects acquire the data,and the respiratory rates, the heart rates, and the blood pressures ofthe subjects are determined according to the data.

In some implementations, the method also includes managing the subjectsbased on the relative states.

In some implementations, the method also includes assigning tasks to thesubjects based on the relative states of the subjects.

In some implementations, one or more of the subjects are put into anathletic contest according to the relative states of the subjects.

In some implementations, a subject is put into the athletic contest ifone or more of the respiratory rate, the heart rate, and the bloodpressure of the subject is above a respective threshold.

In some implementations, one or more of the subjects are assignedparticular combat tasks according to the relative states of thesubjects.

In some implementations, a subject is assigned a particular combat taskif one or more of the respiratory rate, the heart rate, and the bloodpressure of the subject is above a respective threshold.

In some implementations, the relative states include one or more ofrelative psychological states, relative physical states, and relativestates of readiness.

In some implementations, the two or more subjects are managed based onthe relative states.

In some implementations, the processor is also configured to assigntasks to the subjects based on the relative states of the subjects.

In some implementations, one or more of the subjects are put into anathletic contest according to the relative states of the subjects.

In some implementations, one or more of the subjects are assignedparticular combat tasks according to the relative states of thesubjects.

In another aspect, a method includes processing data in a first datasetthat represents time-varying information about at least one pulsepressure wave propagating through blood in a subject acquired at alocation of the subject while the subject is sleeping. The method alsoincludes processing data in a second dataset that representstime-varying information about motion of the subject acquired at thelocation of the subject while the subject is sleeping. The method alsoincludes determining, based on the data, information about acharacteristic of the subject's sleep.

In another aspect, one or more machine-readable storage devices storesinstructions that are executable by one or more processing devices toperform operations including processing data in a first dataset thatrepresents time-varying information about at least one pulse pressurewave propagating through blood in a subject acquired at a location ofthe subject while the subject is sleeping. The operations also includeprocessing data in a second dataset that represents time-varyinginformation about motion of the subject acquired at the location of thesubject while the subject is sleeping. The operations also includedetermining, based on the data, information about a characteristic ofthe subject's sleep.

In another aspect, a biofeedback device configured to be worn by asubject includes a light source configured to emit light toward the skinof the subject. The device also includes an optical sensor configured toreceive the emitted light after the emitted light reflects off of theskin of the subject. The optical sensor is also configured to providedata that corresponds to a characteristic of the received light, thedata representing time-varying information about at least one pulsepressure wave propagating through blood in the subject acquired by theoptical sensor at a location of the subject. The device also includes amotion sensor configured to provide data that represents time-varyinginformation about motion of the subject acquired by the motion sensor atthe location of the subject. The device also includes a processorconfigured to receive data from one or more of the light-emittingelement, the optical sensor, and the motion sensor. The processor isalso configured to determine, based on the data, information about acharacteristic of the subject's sleep.

Implementations can include one or more of the following features.

In some implementations, the information about at least one pulsepressure wave propagating through blood in the subject includesphotoplethysmographic (PPG) data and the information about motion of thesubject includes one or both of motioncardiogram (MoCG) data and grossmotion data.

In some implementations, the data is acquired continuously.

In some implementations, the data is acquired at a frequency of at least16 Hz.

In some implementations, the data is acquired at a frequency of between75 Hz and 85 Hz.

In some implementations, the data is acquired at a single location ofthe subject.

In some implementations, the data is acquired by a device worn by thesubject.

In some implementations, the device is mobile and does not reduce amobility of the subject.

In some implementations, the device processes the data.

In some implementations, the single location is an arm of the subject.

In some implementations, the single location is a wrist of the subject.

In some implementations, the method also includes generating a reducedset of data by excluding data associated with non-sleep periods of thesubject.

In some implementations, a period of time is identified as a non-sleepperiod based on gross motion data of the subject.

In some implementations, identifying the period of time as a non-sleepperiod includes determining that the gross motion data during the periodof time is above a threshold.

In some implementations, identifying the period of time as a non-sleepperiod includes determining that the gross motion data during the periodof time is substantially irregular.

In some implementations, a period of time is identified as a sleepperiod based on gross motion data of the subject.

In some implementations, identifying the period of time as a sleepperiod includes determining that the gross motion data during the periodof time is below a threshold.

In some implementations, identifying the period of time as a sleepperiod includes determining that the gross motion data during the periodof time is substantially flat.

In some implementations, the method also includes determining a startand an end of the sleep period.

In some implementations, determining the start of the sleep periodincludes identifying a time when the gross motion data falls below athreshold, and determining the end of the sleep period includesidentifying a time when the gross motion data rises above a threshold.

In some implementations, the method also includes calculating a propertyof the sleep of the subject based on the data.

In some implementations, the property is associated with one or more ofheart rate, heart rate variability, activity level, respiratory rate,and blood pressure of the subject.

In some implementations, one or more of the heart rate, the heart ratevariability, the activity level, the respiratory rate, and the bloodpressure of the subject are determined based on the processed data.

In some implementations, determining the heart rate of the subjectincludes calculating a distance between two consecutive reference pointsin the first dataset, the distance representing a time that has elapsedbetween two consecutive heartbeats of the subject.

In some implementations, the reference points are local maxima or localminima.

In some implementations, the reference points are peaks or valleys.

In some implementations, determining the heart rate variability of thesubject includes calculating distances between multiple pairs ofconsecutive reference points in the first dataset, each distancerepresenting a time that has elapsed between two consecutive heartbeatsof the subject.

In some implementations, determining the blood pressure of the subjectincludes identifying a first point in the first dataset, the first pointrepresenting an arrival time of the pulse pressure wave at a first bodypart of the subject. Determining the blood pressure of the subject alsoincludes identifying a second point in the second dataset, the secondpoint representing an earlier time at which the pulse pressure wavetraverses a second body part of the subject. Determining the bloodpressure of the subject also includes computing a pulse transit time(PTT) as a difference between the first and second points, the PTTrepresenting a time taken by the pulse pressure wave to travel from thesecond body part to the first body part of the subject, wherein the PTTis related to an internal pressure of one or more blood vessels of thesubject. Determining the blood pressure of the subject also includesdetermining the blood pressure of the subject based on the internalpressure of the one or more blood vessels.

In some implementations, the first body part is the location of thesubject at which the data in the first data set is acquired, and thesecond body part is the heart of the subject.

In some implementations, the characteristic of the subject's sleep isdetermined based on the property.

In some implementations, the characteristic includes sleep apnea.

In some implementations, determining that the subject is experiencingsleep apnea includes identifying a simple signal in a heart rate signalof the subject that is acquired during a sleep period of the subject.

In some implementations, determining that the subject is experiencingsleep apnea includes identifying recurring simple signals in the heartrate signal of the subject.

In some implementations, the simple signals recur at least every twominutes during the sleep period of the subject.

In some implementations, the characteristic includes a quality of thesleep, including one or more of a sleep duration, a sleep latency, asleep staging, a number of disturbances, and a number of tosses andturns.

In some implementations, determining information about a characteristicof the subject's sleep includes determining the sleep duration of thesubject.

In some implementations, determining the sleep duration of the subjectincludes determining a total length of time during which the subject wasasleep based on information related to one or more sleep rest periods ofthe subject.

In some implementations, the information related to the one or moresleep rest periods includes a time associated with a beginning of eachsleep rest period, a time associated with an end of each sleep restperiod, gross motion data of the subject during each sleep rest period,and heart rate data of the subject during each sleep rest period.

In some implementations, determining information about a characteristicof the subject's sleep includes determining the sleep latency of thesubject.

In some implementations, determining the sleep latency of the subjectincludes determining a length of time that it takes for the subject totransition from a state of wakefulness to the sleep state based oninformation related to one or more sleep rest periods of the subject andgross motion data of the subject before the subject fell asleep.

In some implementations, determining information about a characteristicof the subject's sleep includes determining the sleep staging of thesubject.

In some implementations, determining the sleep staging of the subjectincludes determining a deepness of the subject's sleep during a portionof each of one or more sleep rest periods of the subject based oninformation related to the one or more sleep rest periods.

In some implementations, the sleep staging of the subject is determinedbased on at least a heart rate and gross motion data of the subjectduring one or more of the portions of the sleep rest periods.

In some implementations, the method also includes alerting the subjectwhen the sleep duration exceeds a threshold while the subject is in alight sleep stage.

In some implementations, the characteristic includes a sleep disorder.

In some implementations, the characteristic includes a level ofnocturnal dip of blood pressure.

In some implementations, the characteristic includes a sleep period.

In some implementations, the method also includes deriving a valuerepresenting an evaluation of a state of the subject based on the data.

In some implementations, the state of the subject includes ahealth-related state.

In some implementations, the state of the subject is associated with oneor more of sleep quality, sleep duration, sleep latency, and sleepstaging.

In some implementations, the value is provided to the subject or toanother party.

In some implementations, the value is derived based on data related tomotion of the subject.

In some implementations, the data is acquired by a device that is wornby the subject and that displays the value.

In some implementations, the device derives the value.

In some implementations, the device provides the data to a remote devicethat derives the value.

In some implementations, the method also includes processing data thatrepresents information about an amount of ultraviolet light that thesubject has been exposed to.

In some implementations, the method also includes correlating acharacteristic of the subject's sleep to the amount of ultraviolet lightthat the subject has been exposed to.

In some implementations, the method also includes correlating a qualityof the subject's sleep to the amount of ultraviolet light that thesubject has been exposed to.

In some implementations, the method also includes correlating a durationof the subject's sleep to the amount of ultraviolet light that thesubject has been exposed to.

In some implementations, the processor is also configured to identify aperiod of time as a non-sleep period based on gross motion data of thesubject measured by the motion sensor.

In some implementations, identifying the period of time as a non-sleepperiod includes determining that the gross motion data during the periodof time is above a threshold.

In some implementations, identifying the period of time as a non-sleepperiod includes determining that the gross motion data during the periodof time is substantially irregular.

In some implementations, the processor is also configured to identify aperiod of time as a sleep period based on gross motion data of thesubject measured by the motion sensor.

In some implementations, identifying the period of time as a sleepperiod includes determining that the gross motion data during the periodof time is below a threshold.

In some implementations, identifying the period of time as a sleepperiod includes determining that the gross motion data during the periodof time is substantially flat.

In some implementations, the processor is also configured to determine astart and an end of the sleep period.

In some implementations, determining the start of the sleep periodincludes identifying a time when the gross motion data falls below athreshold, and determining the end of the sleep period includesidentifying a time when the gross motion data rises above a threshold.

In some implementations, the processor is also configured to calculate aproperty of the sleep of the subject based on the data.

In some implementations, the characteristic of the subject's sleep isdetermined based on the property, and the characteristic of thesubject's sleep includes sleep apnea.

In some implementations, the processor is also configured to determinethat the subject is experiencing sleep apnea. Determining that thesubject is experiencing sleep apnea includes identifying a simple signalin a heart rate signal of the subject that is acquired during a sleepperiod of the subject.

In some implementations, determining that the subject is experiencingsleep apnea includes identifying recurring simple signals in the heartrate signal of the subject.

In some implementations, the simple signals recur at least every twominutes during the sleep period of the subject.

In some implementations, the characteristic includes a quality of thesleep, including one or more of latency to sleep, number ofdisturbances, and number of tosses and turns.

In another aspect, a method includes processing data in a first datasetthat represents time-varying information about at least one pulsepressure wave propagating through blood in a subject acquired at alocation of the subject. The data in the first and second datasets isacquired while the subject is in a situation that requires at least apredetermined amount of alertness of the subject.

In another aspect, one or more machine-readable storage devices storesinstructions that are executable by one or more processing devices toperform operations including processing data in a first dataset thatrepresents time-varying information about at least one pulse pressurewave propagating through blood in a subject acquired at a location ofthe subject. The data is acquired while the subject is in a situationthat requires at least a predetermined amount of alertness of thesubject.

In another aspect, a biofeedback device configured to be worn by asubject includes a light source configured to emit light toward the skinof the subject. The device also includes an optical sensor configured toreceive the emitted light after the emitted light reflects off of theskin of the subject. The optical sensor is also configured to providedata that corresponds to a characteristic of the received light, thedata representing time-varying information about at least one pulsepressure wave propagating through blood in the subject acquired by theoptical sensor at a location of the subject. The device also includes aprocessor configured to receive data from one or both of thelight-emitting element and the optical sensor. The processor is alsoconfigured to process the data to derive a measure of alertness of thesubject.

Implementations can include one or more of the following features.

In some implementations, the method also includes processing data in asecond dataset that represents time-varying information about motion ofthe subject acquired at the location of the subject

In some implementations, the information about at least one pulsepressure wave propagating through blood in the subject includesphotoplethysmographic (PPG) data and the information about motion of thesubject includes one or both of motioncardiogram (MoCG) data and grossmotion data.

In some implementations, the data is acquired continuously.

In some implementations, the data is acquired at a frequency of at least16 Hz.

In some implementations, the data is acquired at a frequency of between75 Hz and 85 Hz.

In some implementations, the data is acquired at a single location ofthe subject.

In some implementations, the data is acquired by a device worn by thesubject.

In some implementations, the device is mobile and does not reduce amobility of the subject.

In some implementations, the device processes the data.

In some implementations, the single location is an arm of the subject.

In some implementations, the single location is a wrist of the subject.

In some implementations, the situation includes one in which alikelihood of harm to one or more human lives is increased if thealertness of the subject is below the predetermined amount.

In some implementations, the situation is one in which a likelihood ofdamage to one or more properties is increased if the alertness of thesubject is below the predetermined amount.

In some implementations, the situation is one in which a likelihood ofeconomic damage is increased if the alertness of the subject is belowthe predetermined amount.

In some implementations, the situation is one or more of air trafficcontrol, intelligence analysis, vehicle driving, machinery driving,security guarding, baggage screening, and aircraft piloting.

In some implementations, the method also includes using the processeddata to derive a measure of alertness of the subject.

In some implementations, the measure of alertness of the subject isbased on one or more of a heart rate, a respiratory rate, a bloodpressure, and an activity level of the subject.

In some implementations, the method also includes activating an alarm ona device worn by the subject if the measure of alertness of the subjectfalls below a threshold.

In some implementations, the device worn by the subject acquires thedata.

In some implementations, the device worn by the subject processes thedata.

In some implementations, the method also includes causing a speed of avehicle being operated by the subject to be decreased if the measure ofalertness of the subject falls below a threshold.

In some implementations, the method also includes causing an alarm in avehicle being operated by the subject to be activated if the measure ofalertness of the subject falls below a threshold.

In some implementations, the method also includes causing a device beingoperated by the subject to be turned off if the measure of alertness ofthe subject falls below a threshold.

In some implementations, the method also includes causing an operationswitch of a vehicle being operated by the subject to be turned off ifthe measure of alertness of the subject falls below a threshold.

In some implementations, the method also includes assigning a task tothe subject based on the measure of alertness.

In some implementations, the subject is put into an athletic contest ifthe measure of alertness of the subject is above a threshold.

In some implementations, the subject is assigned a particular combattask if the measure of alertness of the subject is above a threshold.

In some implementations, the biofeedback device also includes a motionsensor configured to provide data that represents time-varyinginformation about motion of the subject acquired by the motion sensor atthe location of the subject. The processor is also configured to receiveand process the data from the motion sensor.

In some implementations, the biofeedback device also includes atransceiver configured to provide one or both of the processed data andthe measure of alertness.

In some implementations, the transceiver is also configured to cause aspeed of a vehicle being operated by the subject to be decreased if themeasure of alertness of the subject falls below a threshold.

In some implementations, the transceiver is also configured to cause analarm in a vehicle being operated by the subject to be activated if themeasure of alertness of the subject falls below a threshold.

In some implementations, the transceiver is also configured to cause adevice being operated by the subject to be turned off if the measure ofalertness of the subject falls below a threshold.

In some implementations, the transceiver is also configured to cause anoperation switch of a vehicle being operated by the subject to be turnedoff if the measure of alertness of the subject falls below a threshold.

In some implementations, the processor is also configured to assign atask to the subject based on the measure of alertness.

In some implementations, the subject is put into an athletic contest ifthe measure of alertness of the subject is above a threshold.

In some implementations, the subject is assigned a particular combattask if the measure of alertness of the subject is above a threshold.

In some implementations, operations also include processing data in asecond dataset that represents time-varying information about motion ofthe subject acquired at the location of the subject.

In another aspect, a method includes processing data in a first datasetthat represents time-varying information about at least one pulsepressure wave propagating through blood in a subject acquired at alocation of the subject. The method also includes predicting a medicalevent of the subject based on the processed data.

In another aspect, one or more machine-readable storage devices storesinstructions that are executable by one or more processing devices toperform operations including processing data in a first dataset thatrepresents time-varying information about at least one pulse pressurewave propagating through blood in a subject acquired at a location ofthe subject. The operations also include predicting a medical event ofthe subject based on the processed data.

In another aspect, a biofeedback device configured to be worn by asubject includes a light source configured to emit light toward the skinof the subject. The device also includes an optical sensor configured toreceive the emitted light after the emitted light reflects off of theskin of the subject. The optical sensor is also configured to providedata that corresponds to a characteristic of the received light, thedata representing time-varying information about at least one pulsepressure wave propagating through blood in the subject acquired by theoptical sensor at a location of the subject. The device also includes aprocessor configured to receive data from one or both of thelight-emitting element and the optical sensor. The processor is alsoconfigured to predict a medical event of the subject based on the data.

Implementations can include one or more of the following features.

In some implementations, the method also includes processing data in asecond dataset that represents time-varying information about motion ofthe subject acquired at the location of the subject.

In some implementations, the information about at least one pulsepressure wave propagating through blood in the subject includesphotoplethysmographic (PPG) data and the information about motion of thesubject includes one or both of motioncardiogram (MoCG) data and grossmotion data.

In some implementations, the data is acquired continuously.

In some implementations, the data is acquired at a frequency of at least16 Hz.

In some implementations, the data is acquired at a frequency of between75 Hz and 85 Hz.

In some implementations, the data is acquired at a single location ofthe subject.

In some implementations, the data is acquired by a device worn by thesubject.

In some implementations, the device is mobile and does not reduce amobility of the subject.

In some implementations, the device processes the data.

In some implementations, the single location is an arm of the subject.

In some implementations, the single location is a wrist of the subject.

In some implementations, the method also includes alerting a caregiverwhen a medical event of the subject is predicted.

In some implementations, processing the data includes determining one ormore of heart rate, heart rate variability, blood pressure, bloodpressure variability, body temperature, skin temperature, vocaltonality, electrical skin impedance, respiratory rate, blood oxygenlevel, stroke volume, cardiac output, MoCG morphology, and PPGmorphology of the subject.

In some implementations, predicting the medical event of the subjectincludes determining whether a heart rate of the subject satisfies athreshold.

In some implementations, the medical event is tachycardia.

In some implementations, determining the heart rate of the subjectincludes calculating a distance between two consecutive reference pointsin the first dataset, the distance representing a time that has elapsedbetween two consecutive heartbeats of the subject.

In some implementations, the reference points are local maxima or localminima.

In some implementations, the reference points are peaks or valleys.

In some implementations, predicting the medical event of the subjectincludes determining whether a heart rate variability of the subjectsatisfies a threshold.

In some implementations, the threshold is based on whether the subjectexperiences arrhythmia.

In some implementations, determining the heart rate variability of thesubject includes calculating distances between multiple pairs ofconsecutive reference points in the first dataset, each distancerepresenting a time that has elapsed between two consecutive heartbeatsof the subject.

In some implementations, the reference points are local maxima or localminima.

In some implementations, the reference points are peaks or valleys.

In some implementations, predicting the medical event of the subjectincludes determining whether a blood pressure of the subject satisfies athreshold.

In some implementations, the medical event is hypertension.

In some implementations, predicting the medical event of the subjectincludes determining a rate of change of a blood pressure of thesubject.

In some implementations, the medical event is a stroke, and a stroke ispredicted if the rate of change of the blood pressure of the subject ispositive and above a threshold.

In some implementations, the medical event is abnormal heart function,and abnormal heart function is predicted if the rate of change of theblood pressure of the subject is negative and below a threshold.

In some implementations, the method also includes identifying a firstpoint in the first dataset, the first point representing an arrival timeof the pulse pressure wave at a first body part of the subject. Themethod also includes identifying a second point in the second dataset,the second point representing an earlier time at which the pulsepressure wave traverses a second body part of the subject. The methodalso includes computing a pulse transit time (PTT) as a differencebetween the first and second points, the PTT representing a time takenby the pulse pressure wave to travel from the second body part to thefirst body part of the subject.

In some implementations, the blood pressure of the subject is determinedbased on the PTT.

In some implementations, the first body part is the location of thesubject at which the data in the first data set is acquired, and thesecond body part is the heart of the subject.

In some implementations, the device also includes a motion sensorconfigured to provide data that represents time-varying informationabout motion of the subject acquired by the motion sensor at thelocation of the subject. The processor is also configured to receivedata from the motion sensor.

In some implementations, the device also includes a transceiverconfigured to alert a caregiver when a medical event of the subject ispredicted.

In some implementations, the operations also include processing data ina second dataset that represents time-varying information about motionof the subject acquired at the location of the subject.

Aspects can include one or more of the following advantages.

Particular implementations may realize one, or more of the followingadvantages. Blood pressure and/or other biometric parameters may bemeasured based on continuously acquired data, without the need forcuffs, pressure points or electrodes. “Continuously” acquiring data, asused herein, means acquiring data at a sufficient frequency (e.g., asufficient number of times per second) to allow for the derivation ofthe parameters described herein from that data. The data can, forexample, be collected at a frequency ranging from 16 Hz to 256 Hz. Incertain implementations, the data is acquired at a frequency of between75 Hz and 85 Hz. Vital signs can be measured at one location, using acomfortable and unobtrusive device. By providing an ability to capturecontinuous measurements 24 hour a day, a new paradigm in monitoringhealth can be enabled, thereby allowing for recording transient medicalevents that may otherwise go undetected. The disclosed technology may beintegrated with third party devices (for example, mobile devices)thereby allowing for using external sensors such as motion detectors andlight sensors disposed in the third party devices.

The details of one or more implementations of the subject matterdescribed in this specification are set forth in the accompanyingdrawings and the description below. Other features, aspects, andadvantages of the subject matter will become apparent from thedescription, the drawings, and the claims.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1A illustrates pulse transit time (PTT) calculation using anexample BCGB plot, and a photoplethysmogram (PPG) plot.

FIGS. 1B and 1C are example block diagrams of a device that performsbiometric measurements based on MoCG and PPG data.

FIGS. 1D-1F are plots generated based on data collected using sensors ofthe device of FIGS. 1B and 1C.

FIG. 1G illustrates side and top views of an example configuration ofoptical sensors that can be used in the device of FIGS. 1B and 1C.

FIGS. 2A-2C, 3, and 4 illustrate plots generated based on data collectedby the sensors of the device of FIGS. 1B and 1C.

FIGS. 5A-5E illustrate examples of cardiac signals.

FIGS. 6A-6C are flowcharts depicting example processes for biometricauthentication.

FIG. 7A is a flowchart depicting an example of a process for calculatingmotion pulse transit time (MPTT).

FIG. 7B is a flowchart depicting an example of another process forcalculating MPTT.

FIG. 8 shows examples of heat maps that relate to data collected fromthe motion sensors of the device of FIGS. 1B and 1C, and are used indetermining weights for data corresponding to accelerometers orientedalong different axes.

FIGS. 9, 10A-10C, 11A, and 11B illustrate plots used in calculatingMPTT.

FIG. 12 is a flowchart depicting an example of a process for calibrationof the device of FIGS. 1B and 1C.

FIGS. 13 and 14 illustrate examples related to calibration of the deviceof FIGS. 1B and 1C.

FIGS. 15A-15D and 16A-16C show examples of plots used in detectingvarious heart conditions.

FIG. 17 is a flowchart of an example of a process for detectingarrhythmia.

FIG. 18 is an example of a plot of arterial stiffness vs. exercisefrequency.

FIGS. 19A and 19B are examples of plots used in determining sleepquality and/or sleep disorders.

FIG. 20 is an example of a screenshot for showing sleep quality.

FIG. 21 is a flowchart depicting an example of a process for determiningsleep quality.

FIG. 22 is an example of a screenshot for showing a fitness-relatedmetric.

FIG. 23 is an example of a screenshot for showing a stress-relatedmetric.

FIG. 24 is a flowchart depicting an example of a process for derivinginformation about a psychological state of a subject.

FIG. 25 is a flowchart depicting an example of a process for determininga metric for quality of care provided at a care facility.

FIG. 26 shows an example where the technology described is used byemergency responders.

FIG. 27 is a flowchart depicting an example of a process for determiningrelative states of multiple subjects.

FIG. 28 is a flowchart depicting an example of a process for predictinga medical event.

FIG. 29 is a flowchart depicting an example of a process for determininginformation about a medication regimen.

FIG. 30 shows an example where the technology is used at a medical orcaregiving facility.

FIG. 31 shows an example of the technology being used with a proximitysystem.

FIGS. 32A and 32B show an example implementation of the device of FIGS.1B and 1C in the form of a wearable watch.

FIG. 33 shows an example of an environment where the technology is usedfor access control.

FIG. 34 shows an example where the technology is used for allowing auser to access/operate a vehicle of other machinery.

FIG. 35 shows an example where the technology is used for controllinggaming and/or entertainment systems.

FIG. 36 shows an example where the technology is used for controllingvarious devices connected to a network.

FIG. 37 is an example of a screenshot that displays and allows sharingof blood pressure results.

FIG. 38 is a flowchart depicting an example of a process for controllingremote devices using the technology described in this document.

FIGS. 39A-39C show examples of user interfaces of an application thatmakes data collected by the device of FIGS. 1B and 1C available to auser.

FIG. 40 is an example of a block diagram of a computer system.

DETAILED DESCRIPTION

This document describes technology for determining pulse transit time(PTT) of blood based on motion data such as motioncardiogram (MoCG) data(which is related to, and also referred to in this document asballistocardiogram (BCG) data) and optical data such asphotoplethysmographic (PPG) data. When determined using motion data ofthe body, PTT can also be referred to as motion pulse transit time(MPTT). In this document, the terms PTT and MPTT may be usedinterchangeably. This document also describes technology for performingvarious biometric measurements (e.g., blood pressure, respiratory rate,blood oxygen level, stroke volume, cardiac output, arterial stiffness,and temperature) based on the MoCG data and the PPG data. The MoCG is anexample of a motion of the subject. For example, MoCG is a pulsatilemotion signal of the body measurable, for example, by a motion sensorsuch as an accelerometer or a gyroscope. The pulsatile motion signalresults from a mechanical motion of portions of the body that occurs inresponse to mechanical motion of the heart. For example, the pulsatilemotion signal can result from mechanical motion of portions of the bodythat occurs in response to blood being pumped during a heartbeat. Thismotion is a mechanical reaction of the body to the internal pumping ofblood and is externally measurable. The MoCG signal thereforecorresponds to, but is delayed from, the heartbeat. The MoCG signalrecorded at a given portion of the body therefore represents the motionof the blood due to a heartbeat, but is delayed from, the heart'selectrical activation (e.g. when the ventricles are electricallydepolarized).

PPG data is data optically obtained via a plethysmogram, a volumetricmeasurement of the vasculature. PPG data can be obtained using anoptical device which illuminates the skin and measures changes in lightabsorption. With each cardiac cycle the heart pumps blood resulting in apressure pulse wave within the vasculature. This causes time-varyingchanges in the volume of the vasculature. The changes can be detected,for example, by illuminating the skin with light from a light-emittingdiode (LED) and then measuring the amount of light either transmitted orreflected to a detector such as a photodiode. Each cardiac cycle istherefore represented as a pattern of crests and troughs. The shape ofthe PPG waveform differs from subject to subject, and varies with thelocation and manner in which the waveform is recorded.

FIG. 1A illustrates pulse transit time (PTT) calculation using anexample BCG plot 102, and a photoplethysmogram (PPG) plot 103. BCG plot102 can be analyzed to determine points at which a pulse (or pressurewave) originates at a first location on the body. The BCG however, maybe measured at a second location on the body. For example, the points(e.g., local maxima) 108 a, 108 b and 108 c in the BCG plot 102 mayrepresent time points at which corresponding pulses originate at or nearthe chest. These points are often referred to in this document as pulseorigination points.

The time of arrival of the pulse at a second location (e.g., the wrist)can be determined from PPG data obtained at the second location. Forexample, the PPG data can be measured at the wrist using one or moreoptical sensors. Light from the optical sensors (i.e., the light sourcessuch as LEDs of the optical sensors) is directed toward the skin of thesubject, and the reflected light (which is modulated by blood volumechanges underneath the skin) is measured using one or morephoto-detectors (e.g., photodiodes). The output of the photo-detectormay be amplified by an amplifier before being converted to a digitalsignal (for example, by an analog to digital converter (ADC)) thatrepresents the PPG.

The plot 103 of FIG. 1A represents PPG data that can be used todetermine the arrival time of the pulses at the wrist. For example, themaximum slope points 109 a, 109 b, and 109 c (109 in general) representthe arrival times of the pulses that originated at the chest at timepoints represented by 108 a, 108 b, and 108 c, respectively. Thesepoints may in general be referred to in this document as pulse arrivalpoints 109. The plot 103 is synchronized with the BCG plot 102 such thatthe PTT (or MPTT) 113 between the chest and the wrist can be determinedas a time difference between the originating point at the chest and thecorresponding arrival point at the wrist. In the example shown in FIG.1A, the time difference between 108 b and 109 b represents the PTT 113.Similarly, the time difference between 108 a and 109 a, or the timedifference between 108 c and 109 c can be used in determining the PTT113.

The technology described in this document allows for determination ofPTT from MoCG (or BCG) and PPG data measured at substantially the samelocation on a human body (e.g., the wrist). This includes identifying,from the PPG data, a time point (e.g., the time points 109) at which apulse wave arrives at the location, identifying, from the BCG data, atime point (e.g., the time points 108) at which the pulse originated ata different location on the body (e.g., the heart) from the MoCG data,and determining the PTT 113 as a difference between the two identifiedtime points.

FIG. 1B is a block diagram of an example of a device 100 that performsbiometric measurements based on MoCG and PPG data. The biometricmeasurements can be used for monitoring health related parameters, aswell as in diagnosing conditions and predicting an onset of suchconditions. In some implementations, the device 100 can be a wearabledevice that a subject can wear on the body. For example, the device 100can be disposed in a wearable watch, bracelet, anklet, armband,chest-patch, or belt. An example implementation of the device in theform of a wearable watch 3200 is shown in FIGS. 32A and 32B. The watch3200 includes a case 3202 that is configured to hold the internalcomponents of the watch, including light sources 3204 a, 3204 b, anoptical sensor 3206, a motion sensor 3208, a processor 3210, and anultraviolet light sensor 3212.

In some implementations, the device may also be disposed as a part of agarment worn by the subject. The device 100 may also be disposed in arug or mat (e.g., a bathroom mat or a shower mat). The device 100 mayalso be disposed in a separate device carried or worn by the subject.For example, the device 100 can be disposed internally or externally ina watch or mobile device used by the subject. In some implementations,the device 100 can include a transceiver that is configured tocommunicate wirelessly with another device to perform a biometricmonitoring process. For example, data collected and/or computed by thedevice 100 may be transmitted to an application executing on a mobiledevice for additional analysis or storage. On the other hand, alerts andmessages may be transmitted from a server or mobile device for displayon the device 100. Devices similar to the device 100 are described inU.S. patent application Ser. Nos. 13/166,388 and 13/803,165, and61/660,987, the contents of which are incorporated by reference herein.Various combinations of the operations described in this document mayalso be performed by a general purpose computing device that executesappropriate instructions encoded on a non-transitory computer readablestorage device such as an optical disk, a hard disk, or a memory device.

The device 100 can be configured to make MoCG and PPG measurementseither directly (such as when implemented as a part of an armband,wristband, chest patch, undergarment) or indirectly (such as whenimplemented as part of a mobile device) from a portion of the bodyproximate to the location of the device. The MoCG data can be measuredusing one or more motion sensors 105 such as an accelerometer or agyroscope. In some implementations, the motion sensors 105 includemultiple accelerometers (e.g., one for each of the x, y, and z axes)and/or multiple gyroscopes (e.g., one each for measuring tilt, rotation,and yaw). Even though FIG. 1B shows only motion sensors and opticalsensors, other types of sensors such as electric impedance sensors(including electrical skin impedance sensors, such as Galvanic skinresistance sensors), hydration level sensors, skin reflection indexsensors, and strain sensors can also be used in performing one or moreof the measurements described in this document. In some implementations,one or more of the sensors may be located in an external device such asa mobile device. For example, motion sensors and a camera disposed in amobile device may be used in place of the motion sensors 105 and opticalsensor 110, respectively. In some implementations, the device 100 caninclude one or more sensors to measure or detect ambient conditions.Such sensors can include, for example, a microphone (e.g., to measureenvironmental noise), an altimeter, a humidity sensor, a GPS device (fordetermining geographical location), and an ultraviolet light sensor(e.g. to detect level of sun exposure).

In some implementations, the device 100 can be configured to warn theuser (for example, by displaying a message) if a measured, derived, orinferred health parameter is outside an acceptable range for theparameter. Examples of such health parameters can include (without beinglimited to the following) measured parameters such as heart rate,respiratory rate, or arrhythmia, derived parameters such as bloodpressure, stroke volume, or arterial stiffness, and inferred parameterssuch as mood, stress level, or sleep deprivation. In one example, thelevel of sun exposure (as measured by the ultraviolet light sensor) canbe correlated to the mood or stress level of the user, and relatedsuggestions and recommendations can be provided accordingly. Forexample, if sun exposure above a certain threshold level is known todecrease stress for a particular user, the user may be asked to increasesun exposure during a period when a stress level detected by the device100 is high.

In some implementations, environmental sounds captured by the microphonecan be used to contextualize or interpret vital signs data capturedusing the device 100. For example, a tonality (e.g., amplitude and/orfrequency) of a user's voice can be analyzed to determine if the user isin a confrontational situation (e.g., at work or at home) that can beattributed to an unacceptable level of a particular health parameter(e.g., stress). In another example, environmental noise can be detectedduring a user's commute to determine, for example, if, and to whatextent driving (or rush hour subway) affects the user's healthparameters. In yet another example, if a user is detected to be having adisturbed sleep pattern, the data captured by the microphone can be usedto determine and/or confirm if that is attributable to environmentalnoise (e.g., snoring, or an alarm clock going off). In another example,if an unacceptable condition (e.g., a user's increased stress level)coincides with construction activity (determined, for example, via piledriver sounds captured by the microphone), a determination may be madethat the unacceptable condition is likely due to the sounds coming fromthe construction site.

The data captured using the motion sensors 105 includes both MoCG dataand motion data associated with an activity of the subject. The MoCGdata can be filtered out from the combination using, for example, one ormore band pass filters (BPF) 125 shown in FIG. 1C. In someimplementations, a pass band of the BPF 125 can be designed to filterout constant components (e.g., acceleration due to gravity) and highfrequency noise components. For example, in some cases, a pass band of3-12 Hz may be used for the band pass filter 125. In other casesmultiple band pass filters may be used concurrently. For example, afilter with a 3-12 Hz passband and another filter with a 10-30 Hzpassband can be used simultaneously to measure different parametersmeasurable in the two different bands. In some implementations, the bandpass filtered accelerometers can be combined to obtain an activity index127, which in turn is used in calculating appropriate weights 130 forobtaining updated biometric measurements 132. For example, if thesubject is sitting still, the activity index 127 can be less than athreshold value (e.g., 5) indicating, for example, that the band passfiltered accelerometer outputs can be used directly in determining thebiometric measurements. In another example, if the subject is running,the activity index 127 can be higher (e.g., between 5 and 15),indicating that the band pass filtered accelerometer data may need to beadjusted (e.g., by applying a threshold) before being used indetermining the biometric measurements. In some implementations, if theactivity index is higher than an upper threshold value (e.g., 15), theband pass filtered accelerometer data may be discarded as beingunreliable. In some implementations, weights 130 may be adjusted toreflect if and how the band pass filtered data from the accelerometer105 is used. Examples of band pass filtered accelerometer data areillustrated in FIG. 1F, where plots 170, 172, and 174 represent outputsof accelerometers in the x, y, and z axes, respectively.

In some implementations, the PPG data can be measured using one or moreoptical sensors 110. In some implementations, the optical sensors 110can include one or more light emitting diodes (LEDs) whose output can becontrolled, for example, by a microcontroller. Example configurations ofthe optical sensors 110 are depicted in FIG. 1G. In someimplementations, the optical sensors include a 7.5 mm² photodiode withtwo green LEDs placed within 1.5 mm of either side. The photodiode hasan opaque optical shield surrounding the sides. The LEDs can have a peakwavelength of 525 nm and a viewing angle of 60 degrees.

In operation, light from the optical sensors 110 (i.e., from the lightsources such as LEDs of the optical sensors) is directed toward the skinof the subject, and the reflected light is modulated by blood flowunderneath the skin. The optical sensors 110 also include one or morephoto-detectors (e.g., photodiodes) that receive the reflected light andprovide a resulting signal to the microcontroller. The resulting signalmay be amplified by an amplifier before being converted to a digitalsignal (for example, by an analog to digital converter (ADC)) that isprovided to the microcontroller. The PPG signal is synchronized with theheartbeat and can therefore be used to determine the heart rate (HR) 112of a wearer of the device. This is shown in additional detail in FIG.1C. In some implementations, the heart rate signal can be within aparticular range of the spectrum (e.g., 0 to one half of the samplingfrequency) of the PPG signal 150, and can be isolated using, forexample, a band pass filter (BPF) 154. An example of this is shown inFIG. 1D, where the plot 160 represents raw PPG data, and the plot 162represents the output of the BPF 154. The pass band of the filter usedfor the example depicted in FIG. 1C is 0.4-4 Hz. As seen from FIG. 1C,the low frequency portion of the raw data, as well as the high frequencyvariations are filtered out in the output plot 162.

In some implementations, it could be desirable to sample the optical PPGsensor at a low frequency to achieve power savings. However, a lowsampling frequency can cause interference between the optical sensorsand artificial light sources, which usually oscillate at the frequencyof 60 Hz and 120 Hz in North America, and 50 Hz and 100 Hz worldwide. Ifthe sampling rate is lower than the Nyquist rate corresponding to themaximum frequency (e.g., 120 Hz*2=240 Hz) then aliasing would occur. Forexample, if the PPG sensor is sampled at 121 Hz, then a 120 Hzinterfering source will alias as 1 Hz, which is within the frequency ofheart rate and could cause confusion. In some implementations, afrequency between 75-85 Hz is chosen such that reasonable power savingis achieved, and the optical interferers are aliased into non-biologicaloptical signal frequency range (>10 Hz). For example, if 80 Hz ischosen, then the aliased interferers would be at frequencies such as 20Hz, 30 Hz, and/or 40 Hz. An appropriate low pass filter (e.g., a filterwith cut-off frequency of 10 Hz) could then be used to eliminate theinterferers while preserving the PPG signal. If a finer time resolutionis desired (e.g., corresponding to 256 Hz), the filtered PPG signal canbe interpolated accordingly in time domain without signal loss.

In some implementations, the output of the BPF 154 can be used todetermine a heart rate 144 of the subject, and can also be combined withthe output of the BPF 125 to determine other biometric parameters suchas pulse transit time (MPTT) and stroke volume (SV) 145, as well asother parameters 146, including, for example, systolic and diastolicblood pressure, stroke volume (SV), and cardiac output (CO).

In some implementations, calibration data 155 is used in computing oneor more of the parameters 146. For example, the calibration data 155 caninclude user-specific calibration information (e.g., constants used inequations) that may be used in computing one or more of the parameters146. In some implementations, the calibration data 155 can be computedbased on user-provided data. For example, a user may be asked to providebiographical data such as age, height, and weight for use in computingthe calibration data. In some implementations, the user can be asked toprovide his/her last-known blood-pressure data to determine one or moreconstants or parameters included in the calibration data 155. In somecases, a medical professional may measure a user's blood pressure duringset up of the device 100. In some implementations, calibration data 155can be calculated based on a user action. For example, the user may beasked to hold the device 100 at or near chest level to equalizehydrostatic pressure effects and sense chest vibrations that are used incomputing a calibration point. This way, a delay between a chestvibration and the time of arrival of a pulse wave at the wrist (if thedevice 100 is worn on the wrist) can be used to calibrate for bloodpressure for a scenario where there is no height difference between theheart and the measuring point. In some implementations, the calibrationdata 155 can include information related to skin tone calibration whereLED intensity and amplifier gain are adjusted until an optimal DC levelis reached. If no user-specific calibration data is available, standardcalibration values (for example parameters to get a standard 120/80 mmHgsys/dia measurements) may be included in the calibration data 155. Insome implementations, the calibration factors may be adjustedretroactively once the user enters valid calibration data. Calibrationdata may also be imported from the user's medical records if, forexample, the device is dispensed to the user by their medicalprofessional.

Because the baseline of PPG is modulated by respiration, a signalrepresenting respiratory rate is typically within the 0-1 Hz range ofPPG, and can be obtained using low pass filtering. This is illustratedin FIG. 1C, where the PPG data 150 is passed through the low pass filter(LPF) 152 and optionally combined with the output of another LPF 135(used for low pass filtering the MoCG data) to obtain biometricparameters such as sleep data 142 and respiratory rate 143. An exampleof determining the respiratory rate 143 from the PPG data 150 isillustrated in FIG. 1E. In this example, the plot 166 represents the rawPPG data, and the plot 168 shows the output of the LPF 152 representingthe low frequency variations due to respiration.

In some implementations, other biometric parameters may also becomputed. For example, by using multiple LEDs of different colors in theoptical sensor 110, blood oxygenation (SpO₂) can be obtained using pulseoximetry theory. Computation of other biometric parameters is describedbelow. Referring again to FIG. 1B, the device 100 can also include acomputing device 115 that can be configured to compute the biometricparameters, including, for example, blood pressure, respiratory rate,blood oxygen, stroke volume, cardiac output, and temperature. In someimplementations, an activity index 148 (which may be the activity index127, also shown in FIG. 1C) can be used in determining a set of weights147 used in calculating one or more of the biometric parameters 146.

As seen from FIG. 1C, the heart rate information 144 is used incalculating one or more of the biometric parameters 146. In someimplementations, the heart rate information 144 can be obtained from thePPG by detecting peaks and/or valleys in a graphical representation(e.g., the plot 162 shown in FIG. 1C) of the PPG data 150. This caninclude, for example, cross-correlating a portion of the PPG data (e.g.,samples or data corresponding to a two second segment of the plot 162 ofFIG. 1C) with similar segments to produce a plot 180 (shown in FIG. 2A)representing a series of cross-correlation products. In one example,two-second segments from the plot 162 are cross-correlated with adjacent(possibly with some partial overlap) two-second segments to produce theplot 180 of FIG. 2A. A particular cross correlation result (for example,one that produces the highest cross-correlation amplitude) can then beselected as a template. The plot 178 shown in FIG. 2B is an example of atemplate. In some implementations, the template can be adjusted toconform to a desired morphology, allowing for a beat to beat naturalvariation but discounting noise and non-heartbeat signals.

The selected template can then be correlated with segments from the plot162 (shown in FIG. 1C) to identify locations of correlation peaks. Thisis illustrated in FIG. 2A, where the plot 180 represents a series ofsuch peaks. The location of the correlation signal peaks can be used todirect a search for valleys, inflection points, and/or peaks within theband pass filtered PPG signal. The inflection point in this case isdefined as the point of maximum slope. FIG. 2C illustrates an example ofa PPG signal with identified peaks 181, inflection points 183 andvalleys 185. For brevity, only a few of the peaks, inflection points,and valleys are marked using the reference numbers 181, 183, and 185,respectively. The distance between two consecutive valleys (orinflection points or peaks) represents a time difference between twoconsecutive heartbeats, and can be used to compute instantaneous heartrate. For example, if two valleys (or inflection points or peaks) areseparated by 141 samples, and if the sampling rate is 128 Hz, theinstantaneous heart-rate can be computed as 60*128/141=54.47beats-per-minute (BPM). The instantaneous heart rate for each of theheartbeats can be plotted as shown in FIG. 3, and can be used for otherpurposes such as computing other parameters and diagnosing conditionssuch as arrhythmia.

In some implementations, confidence levels associated with a calculatedinstantaneous heart rate can be determined before being used in anysubsequent analysis. For example, if a person suddenly stands up from asitting position, the instantaneous heart rate during the transition mayshoot up. In some implementations, the rate of such rapid increase caninclude meaningful information. However, in some implementations, theinformation obtained during this transition may not be reliable as anindicator of the person's health status. Determining confidence levelsassociated with the computed heart rates can allow for discarding suchoutliers in subsequent analyses. In some implementations, a givencomputed instantaneous heart rate can be compared, for example, to theaverage (or median) instantaneous heart rate over a predetermined timerange (e.g., ±10 seconds) to determine whether the given instantaneousheart rate is reliable. If the given instantaneous heart rate differs(e.g., differs by more than a predetermined amount) from the averageheart rate over the predetermined time range, the given instantaneousheart rate may be determined to be unreliable and therefore de-weighedin subsequent computations. This allows for selecting reliable datapoints at the expense of a short latency (10 seconds in the aboveexample).

In some implementations, the instantaneous heart-rate data as shown inFIG. 3 can be used for computing instantaneous heart-rate variability(HRV). An example of HRV plotted against the corresponding heartbeats isshown in FIG. 4. As shown in FIG. 4, the HRV data can be used tocalculate a mean HRV for a set of heartbeats. In some implementations,HRV data can be used in detecting conditions such as stress. Forexample, if the mean HRV is above a certain threshold, the subject maybe determined to be under higher than usual stress. In the time domain,HRV can be calculated by computing a variance of individual RR intervals(distance between the ‘R’ points of two consecutive QRS complex curvesrepresenting heartbeats, or alternatively the distance between valleysas shown in FIG. 2C) from the average RR interval, over a period of time(e.g., 5 minutes). Alternatively, the HRV can also be calculated in thefrequency domain by comparing the power spectrum at very low frequencies(e.g., 0.04-0.15 Hz) with the power spectrum at slightly higherfrequencies (e.g., 0.18 to 0.4 Hz).

Cardiac waveform morphology (also referred to as cardiac morphology) canbe defined as the shape of a plot representing cardiac activity. FIG. 5Arepresents a Wiggers diagram, which is a standard diagram used incardiac physiology. Referring to FIG. 5A, the shape of anelectro-cardiogram (ECG) QRS complex 505 represents a morphologyassociated with a heartbeat. Cardiac morphology depends on where and howcardiac activity is measured. For example, the morphology 510 of aphonocardiogram signal is different from that of the ECG morphology 505.In another example, the morphology associated with ventricular volume515 is different from the morphology associated with ventricularpressure 520.

FIG. 5B shows an example of a cardiac signal illustrating the morphology525 associated with a PPG signal. The morphology of a measured PPGsignal can be checked to determine whether the measured PPG signalreliably represents heartbeats. In some implementations, the relativeseparations of the peaks and valleys of the PPG signal are analyzed todetermine whether the PPG signal reliably represents heartbeats. Forexample, a segment of the PPG signal can be determined to representheartbeats if the following threshold condition is satisfied:

0.25<Median (peak to valley distances)/Median (valley to valleydistances)<0.4

The condition above uses the range [0.25, 0.4] as an example, and othervalues can also be used. For example, the range (or threshold) could bedetermined for an individual user by using, for example, a rangeconsidered to be normal for the particular user. The ratio from theabove condition can vary within the range for various conditions of thesubject. For example, the ratio can be at a low portion of the rangeduring relaxation or sleep conditions, and at a high portion of therange during stressful events such as anger or fear. In someimplementations, other morphology checks can also be performed. Forexample, one morphology check can involve verifying that at a restingposition, the user's systolic amplitude is approximately half of thediastolic amplitude. In some implementations, segments that do notsatisfy the morphology check conditions are discarded from being used inbiometric parameter computations.

Cardiac morphology also typically varies from one person to another dueto, for example, unique heart beat signatures, breathing patterns andthe unique ‘transmission line’ reflection signatures that are caused bythe lengths and stiffness of an individual's arteries. In A typical PPGsignal the main peak represents the first systolic peak which isfollowed by the secondary peak (or bump) representing the earlydiastolic peak (or reflection). The time between the two peaks is alsoinversely proportional to arterial stiffness. This is easier tovisualize from the first and/or the second derivatives of the PPGsignal. FIGS. 5C and 5D show examples of cardiac signals illustratingmorphology based on PPG signals. In the example of FIG. 5C, thederivative 538 of the PPG signal 539 shows a discernible second peak540, whereas in the example of FIG. 5D, the corresponding second peak545 is comparatively weaker. However, the example of FIG. 5D shows thepresence of a third peak 550. Therefore, in some implementations,cardiac morphology can be used as a biometric identifier. For example,the device 100 described with reference to FIG. 1B can be configured toverify, based on a determined cardiac morphology, that the personwearing the device is the person for whom the device was assigned. Insome implementations, the determined cardiac morphology may also be usedto uniquely identify a wearer of the device 100. Such biometricidentification can be used, for example, in security and accessibilityapplications. For example, the device 100 can be configured to transmita cardiac morphology based signature to a receiver (e.g., on a mobilephone, or at secured access point) to gain access to a secure resource.In some implementations, when a same device is used by multipleindividuals (e.g., different members of a family), the wearer of thedevice may be identified based on the identified cardiac morphology ofthe wearer. FIG. 5E shows examples of cardiac signals illustratingmorphology for four different individuals, and illustrates how thecardiac morphology varies from one person to another.

Security Applications

In some implementations, multiple measured or derived parameters can beused as a biometric signature to uniquely identify a wearer. Forexample, a wearer can be identified based on a multi-dimensional spacedefined based on the measured or derived parameters. Because theparameters vary from one person to another, each person would be mappedto a different region within the multi-dimensional space. A simpletwo-dimensional example of such a space can be defined, for example, byusing heart rate as one axis and PPG shape as the second axis. Becausethe PPG shape and heart rate varies from one person to another, eachperson can typically be mapped to a separate region on thetwo-dimensional plane, and can be identified based on a location of theregion. Higher dimensional spaces can be used for robustly identifyingindividuals among a large population. Examples of parameters that can beused as axes for such spaces include cardiac morphology, heart rate,cardiac volume, PPG, or other parameters derived as a function of one ormore of these parameters. In another example, cardiac morphology can becombined with another parameter such as the MoCG morphology to achieveincreased accuracy and/or resolution for bio-authenticationapplications. Examples of such applications include access control,digital wallet authorization, digital passwords/signature andenvironmental control. In such cases, MoCG data can be used to provide aMPTT signature and/or a MoCG signature waveform that may be unique to aparticular user.

In some implementations, the biometric signature based useridentification can be used in electronic payment applications. In someimplementations, the device 100 can be configured to communicate with apayment gateway using, for example, near field communication (NFC) orBluetooth Low Energy (BLE) protocols. The payment gateway can beconfigured to identify the user based on a corresponding biometricsignature to initiate the payment process. The payment gateway cancommunicate the identification information to a server that storescredit card or bank information of the corresponding user, for example,within a corresponding user account. Upon receiving identification ofthe user, the server may initiate communications with the paymentgateway that result in the credit card being charged or the bank accountbeing debited.

In some implementations, the biometric signature based useridentification is disabled if the device determines that the wearer isunder distress. The device can determine whether the wearer is underdistress based on the wearer's vital signs (e.g., such as heart rate(HR), heart rate variability (HRV), blood pressure (BP), and respiratoryrate). For example, if a wearer of the device is being forced to accessa payment gateway, the device can detect the wearer's distress, asindicated by a sudden increase in HR, BP, and/or respiratory rate, andprevent him or her from accessing the payment gateway. Similarly, insome examples, if a wearer of the device is being forced to unlock alock (e.g., a lock on a door of the wearer's home), the device candetect the wearer's distress, as indicated by a sudden increase in HR,BP, and/or respiratory rate, and prevent him or her from unlocking thelock.

In some implementations, the wearer's vital signs do not produce a matchof the wearer's biometric signature when the wearer is under distress.For example, when the wearer is under distress, the multi-dimensionalspace defined based on the measured or derived parameters takes on amodified for that does not match the wearer's biometric signature. Assuch, a wearer under distress is unable to be identified by thebiometric signature.

In some cases, a wearer may exhibit signs that are synonymous withdistress when the wearer is not in fact in distress. For example, if thewearer is involved in a non-dangerous and exciting event, such as buyingan extremely expensive item, the wearer may experience an increase inHR, BP, and/or respiratory rate that may mistakenly be interpreted bythe device as signs of distress. Thus, in some implementations, thewearer is provided with an opportunity to authenticate himself orherself in the event that the device detects false signs of distress orfails to identify the biometric signature of the wearer. The wearer canauthenticate himself or herself using confidential information such as apassword or a personal identification number that is communicated to thedevice or a server in communication with the device. In someimplementations, the wearer can authenticate himself or herself byperforming a private, predefined gesture. The one or more motion sensorsof the device can be configured to determine whether the authenticatinggesture matches the predefined gesture.

An example process 600 of bio-authenticating a subject is shown in FIG.6A. A machine, such as a processor, that receives information from theoptical sensors 110 of the device 100 can perform one or more steps ofthe process 600. In some implementations, the machine can include thecomputing device 115 described above with reference to FIG. 1B. In theprocess 600, initially, data in a dataset that represents time-varyinginformation about at least one pulse pressure wave propagating throughblood in a subject can be processed (602). The data can be acquired at alocation of the subject (e.g., the arm or the wrist of the subject). Adetermination can then be made of whether one or more segments of thedataset were captured from a subject other than an expected subject(604). The determination can be made by analyzing morphological featuresof the segments.

Another example process 610610 of bio-authenticating a subject usinginformation about motion of the subject is shown in FIG. 6B. A machine,such as a processor, that receives information from the motion sensor105 of the device 100 can perform one or more steps of the process610610. In some implementations, the machine can include the computingdevice 115 described above with reference to FIG. 1B. In the process610, initially, data in a dataset that represents time-varyinginformation about motion of a subject can be processed 612). The datacan be acquired at a location of the subject (e.g., the arm or the wristof the subject). A determination can then be made of whether one or moresegments of the dataset were captured from a subject other than anexpected subject 614). The determination can be made by analyzingmorphological features of the segments.

Another example process 620 of bio-authenticating a subject is shown inFIG. 6C. A machine, such as a processor, that receives information fromthe motion sensor 105 and the optical sensors 110 of the device 100 canperform one or more steps of the process 620. In some implementations,the machine can include the computing device 115 described above withreference to FIG. 1B. The machine may also use the calculated MPTT tofurther generate additional biometric measurements, the processes forwhich are discussed below. In the process 620, initially, data in afirst dataset that represents time-varying information about at leastone pulse pressure wave propagating through blood in a subject can beprocessed (622). Data in a second dataset that represents time-varyinginformation about motion of the subject can also be processed (624). Thedata can be acquired at a location of the subject (e.g., the arm or thewrist of the subject). Based on the first and second datasets, at leasttwo parameters of the subject can be determined (626). The parameterscan include one or more of blood pressure, respiratory rate, bloodoxygen levels, heart rate, heart rate variability, stroke volume,cardiac output, MoCG morphology, and PPG morphology. A biometricsignature of the subject can then be determined (628). In someimplementations, the (628). The biometric signature can be representedin a multi-dimensional space. Each axis can correspond to at least oneof the determined parameters. A determination can then be made ofwhether the biometric signature was captured from a subject who is anexpected subject (630). The determination can be made by analyzingfeatures of the biometric signature.

In some implementations, the biometric signature based useridentification can be used in providing rewards and/or discounts to auser. For example, if the identified user is determined to be adheringto a particular exercise regimen, reward points or incentives such asdiscounts on particular products can be credited to the correspondinguser account. Therefore, a user can be motivated to keep adhering toparticular good practices to keep getting such rewards or discounts.

Motion Pulse Transit Time (MPTT) Calculation

The information collected from the motion sensors 105 and the opticalsensors 110 of FIG. 1B is used to calculate the MPTT, which can be usedto further calculate the biometric parameters, such as blood pressure,stroke volume, etc. An example process 700 for the MPTT calculation isshown in FIG. 7A. A machine, such as a processor, that receives theinformation from the motion sensors 105 and the optical sensors 110 canperform one or more steps of the process 700700. The machine may furtherprovide the calculated results to, for example, the wearer, anotherperson who is interested and authorized to receive the information, oranother machine for further data processing or data storage. In someimplementations, the machine can include the computing device 115described above with reference to FIG. 1B. The machine may also use thecalculated MPTT to further generate additional biometric measurements,the processes for which are discussed below.

In the process 700, initially, the MoCG data for use in the MPTTcalculation can be preprocessed (702). During any time period, themotion sensor or sensors (e.g., the accelerometers) collect three setsof MoCG data along three orthogonal axes, x, y, and z, or along polarcoordinates. The three sets may be combined by selecting a weight,w_(x), w_(y), w_(z) for each set and summing the weighted sets. Anexample of the weight selection is shown in FIG. 8, which illustratestwo dimensional heat-map diagrams 800, 802, and 804 produced from powerspectra of MoCG ensembles collected over time. In each of the diagrams800, 802, 804, the horizontal axis represents the frequency and thevertical axis represents frames of MoCG data collected over time.Therefore each row in the diagrams represents the power spectrum of acorresponding frame of MoCG data. The colors represent the values of theenergy level. The weights w_(x), w_(y), w_(z) can be assigned, usingrespective diagrams, based on the ratio of energy inside the heart raterange to the energy outside the heart rate range. If the power spectrais consistent across the different frames and/or is a harmonic of thealready calculated heart rate (as illustrated in the diagram 804), thecorresponding axis (the z axis in this example) is assigned a higherweight than the other axes. The lines 806, 808, and 810 in FIG. 8represent the first, second, and third harmonic, respectively of themeasured heart rate in this time segment. In the example shown in FIG.8, the assigned weights are w_(x)=0.03, w_(y)=0.15, and w_(z)=0.95. TheMoCG data for the MPTT calculation is then calculated as the weightedsum of the three sets of MoCG data for the three axes. Alternatively, asingle axis can be selected (e.g., the axis with the highest weight)while ignoring the others. For example, only the z axis can be selectedfor the example shown in FIG. 8. In some implementations, axis selectioncan be performed by independently analyzing each axis and then combiningthe axes based on agreement of the candidate MPTT values. This may bedone, for example, to avoid the calculation of a power spectrum signalwithout sacrificing on the accuracy.

Referring again to FIG. 7A, a representative segment of the PPG data isgenerated (704704) for calculating the PPT. In some implementations, therepresentative PPG segment is generated by averaging across multiple PPGsegments of the same length.

FIG. 9 shows an example of the representative segment 904 of the PPGdata used in determining the MPTT. The representative segment 904 inthis example is calculated by averaging across multiple segments 906 ofequal duration. The MoCG data is then analyzed using the representativesegment (706) to calculate candidate MPTT values. The representativesegment can be calculated, for example, by averaging across multiplesegments of equal duration arranged on the same time grid as arepresentative PPG signal. A short segment of the MoCG data 902 (ofequal duration to the representative segment 904) and the representativesegment 904 are aligned in time, for example, by aligning inflectionpoints (or valleys or peaks). The length of the segment 904 and thecorresponding MoCG data can be in the order of several seconds. In theexample shown in FIG. 9, the length of the segment 904 is 2 seconds.However segments of other lengths (e.g. 1.5 seconds-5 second) can alsobe used. In some implementations, the representative segment isgenerated from data collected when a user is stationary, so that thedata does not include a significant amount of unwanted noise.

In some implementations, the MPTT is measured as the difference betweena time point to when a mid-systole portion 908 of the representative PPGsegment 904 is measured, and a second time point representing theportion of MoCG data corresponding to the mid-systole. Because the MoCGdata represents the motion due to an actual heartbeat, and the PPG datarepresents a pulse wave arrival recorded at a distance from the heart,the second time point generally occurs before t₀. Since a human body isnot a rigid body, as defined by the laws of mechanics, the MoCG pulsearrives at the location where the device is located in a somewhatdelayed (but constant per individual) fashion. The portion of MoCG datacorresponding to the mid-systole is typically manifested as a peak orvalley in the MoCG data, and the MPTT can be determined by identifyingthe correct peak or valley corresponding to the mid-systole. Whilemid-systole is used as a reference point in this example, other portionsof the cardiac morphology can also be used as the reference point. Basedon a priori knowledge of typical MPTT, a predetermined time rangerelative to t₀ is searched and the peaks and valleys detected within thepredetermined time range are flagged as potential candidates for beingthe correct peak or valley corresponding to the mid-systole. Therefore,the difference between the time point corresponding to each such valleyor peak and the time to represents a hypothetical MPTT. The correct MPTTvalue is determined based on the hypothetical MPTTs, as described usingthe example below.

The predetermined time range can be chosen to be, for example, between10 to 400 ms, or another duration longer than an actual expected range.Within the predetermined time range, seven peaks and valleys 910, 912,913, 914, 916, 918, 920, corresponding to time points t₁, t₂, t₃, t₄,t₅, t₆, t₇, respectively, are identified on the MoCG plot 902.Accordingly, seven hypothetical MPTTs are determined as, h₁=t₀−t₁,h₂=t₀−t₂, h₃=t₀−t₃, h₄=t₀−t₄, h₅=t₀−t₅, h₆=t₀−t₆, and h₇=t₀−t₇.

Next, for a given hypothetical MPTT (e.g., h₁), a longer segment 1000 ofthe MoCG data (e.g., of 20 second duration, as shown in FIG. 10A) isaligned with the corresponding PPG data, and the time pointscorresponding to mid-systoles in the PPG pulses are identified asreference points. The MoCG data is checked at each time point precedingthe reference points by h₁ (and possibly within a small time rangearound such time points) for the presence of a peak or valley. If a peakor valley is detected, it is flagged, and the total number of flaggedpeaks and valleys for the entire segment of MoCG data are recorded. FIG.10A illustrates a 20 second segment of MoCG data, along with flaggedpeaks and valleys corresponding to one particular hypothetical MPTT. Inthe example of FIG. 10A, the flagged peaks and valleys are identified bymarkers (e.g., circles) 1008, 1010.

The above process is repeated for each of the hypothetical MPTTs and thetotal number of peaks or valleys are recorded for each case. The plotscorresponding to two other hypotheses are illustrated in FIGS. 10B and10C. In some implementations, one of the hypothetical MPTTs is chosen asthe true MPTT value, based on the recorded number of peaks or valleys.For example, the hypothetical MPTT that yields the maximum number ofpeaks or valleys can be chosen as the true MPTT value. In someimplementations, the hypothetical MPTTs can be combined together as aweighted sum to obtain the true MPTT value. The weights can be assignedbased on, for example, a ratio of the number of flagged peaks (orvalleys) to the total number of reference points, and a consistency ofthe flagged peaks (or valleys) defined as a signal-to-noise ratio:

SNR=mean (amplitudes of flagged peaks)/standard deviation (amplitudes offlagged peaks)

A weight for a given hypothetical MPTT can then be determined as:

Weight=((Number of flagged peaks)/(total reference points))²*log (SNR)

Next, a 2D histogram or is generated (708) from the MPTT valuescalculated during a predetermined time range. For example, thepredetermined time range can be the duration for which a user wears thedevice 100. An example of such a histogram is shown in FIG. 11A, wherethe y axis represents a calculated MPTT value (averaged over 60seconds), the y axis represents time, and the darkness of each pointrepresents calculated confidence measure associated with the calculatedMPTT. The different horizontal sets represent candidate MPTT values fordifferent time ranges. A representative set can be selected from thecandidate sets based on, for example, a priori knowledge about theexpected MPTT, and/or confidence measures associated with the points inthe set. For example, from FIG. 11A, the sets 1111 or 1112 can beselected as the best representative sets for the MPTT, based on theconfidence levels associated with the points (as represented by thedarkness of the points), as well as a priori knowledge that the MPTT isexpected to be within a 250-350 ms range. Therefore, more consistent(and hence reliable) estimates of MPTT values can be identified from thehistograms, and the average MPTT value over the predetermined time rangecan be calculated (710), for example, as an average of the consistentMPTT values. Inconsistent MPTT values can be discarded from beingincluded in computing the average MPTT. Other parameters such as averageSV can also be calculated using similar plots. Before generating suchplots, individual estimates of SV (in ml/heartbeat) can be calculatedfrom the amplitude of the MoCG signal based on the fact that SV variesdirectly with the average amplitude of the MoCG.

In some implementations, only one candidate MPTT value can be selected.For example, the candidate MPTT value having the highest weights and/oran appropriate or expected morphology can be selected. In someimplementations, a confidence measure can be determined for eachmeasurement of MPTT (or other biometric parameters) to indicate theconfidence one has in the reading. An example is shown in FIG. 11B,which illustrates computation of confidence measures 1120 correspondingto the calculated values of MPTT 1115. The confidence measures can beused, for example, to determine whether a calculated value can be usedfor subsequent computations.

An example process for calculating MPTT is shown in FIG. 7B. The processcan be executed, for example by the device 100 described above withreference to FIG. 1B. Operations of the process can include obtaining afirst data set representing time-varying information on at least onepulse pressure wave within vasculature at a first body part of a subject(722). The first data set can be obtained from a first sensor such as aPPG sensor. The operations also include obtaining a second data setrepresenting time-varying information about motion of the subject at thefirst body part of a subject (724). The second data set can be obtainedfrom a second sensor such as a motion sensor.

The operations further include identifying a first point in the firstdata set, the first point representing an arrival time of the pulsepressure wave at the first body part (726) and identifying a secondpoint in the second dataset, the second point representing an earliertime at which the pulse pressure wave traverses a second body part ofthe subject (728). Identifying the first point can include, for example,computing a cross-correlation of a template segment with each ofmultiple segments of the first dataset, identifying, based on thecomputed cross-correlations, at least one candidate segment of the firstdataset as including the first point, and identifying a first featurewithin the identified candidate segment as the first point. Identifyingthe second point can include, for example, determining a reference pointin the second data set, wherein the reference point corresponds tosubstantially the same point in time as the first point in the firstdata set. One or more target features can then be identified within apredetermined time range relative to the reference point, and a timepoint corresponding to one of the target features can be selected as thesecond point.

The operations also include computing MPTT as a difference between thefirst and second time points (730). The MPTT represents a time taken bythe pulse pressure wave to travel from the second body part to the firstbody part of the subject can then be used in computing variousparameters such as blood pressure or arterial stiffness.

Use of the MPTT and SV values

The calculated MPTT value is related to elasticity of the blood vesselsas shown in the following equation:

$\begin{matrix}{{{PTT} = {\frac{L}{PWV} = \frac{L}{\sqrt{\frac{Eh}{2\rho \; r}}}}},} & (1)\end{matrix}$

where L is the vessel length, PWV is the pulse wave velocity, E is theYoung's modulus, h is the vessel wall thickness, ρ is the blood density,and r is the vessel radius.

The elasticity is in turn related to the vessel pressure P as:

E=E ₀ e ^(αP),  (2)

where E₀ is an elasticity parameter, and a is about 0.017 mmHg-1. Basedon (1) and (2), the vessel pressure P can be derived as:

P=A ln(PTT)+B,  (3)

where A and B are parameters calculated as follows:

$A = {- \frac{2}{\alpha}}$$B = {\frac{1}{\alpha}{\ln\left( \frac{2L^{2}\rho \; r}{E_{o}h} \right)}}$

The pressure value calculated using (3) represents diastolic pressure(Dia). The systolic pressure (Sys) can then be computed as:

Sys=Dia+C*SV,  (5)

where A is a universal constant that applies to all users and isunitless, B is an individual constant in units of mmHg, C is anindividual constant in units of mmHg/mg, and SV is the stroke volume.

Calibration

The parameters B and C for calculating the diastolic and systolicpressures may vary from one person to another. Accordingly, a process ordevice may need to be calibrated for an individual before use.Generally, the calibration is performed the first time the accelerometerand the optical sensor are used for measuring and the algorithms areused for calculating the MPTT, SV, and the other parameters.

An example process 1200 of calibration performed by a machine, such as aprocessor, is shown in FIG. 12. The machine receives (1202) knownreference systolic and diastolic pressures (Sys0 and Dia0), e.g., asinput from a wearer. If the pressures are unknown to the wearer, genericvalues of 120/80 mmHg are used. In such cases, the wearer may be allowedto alter the calibration at a later time when the actual pressuresbecomes known. The machine also calculates (1204) the MPTT and the SVusing methods described above. The machine then calculates the constantsB and C (1206) for this particular wearer based on the followingequations:

B=refDia−A ln(MPTT), and

C=(refSys−refDia0)/SV.

The values of the parameters are saved or stored (1208) for theindividual. In some situations, a device (e.g., the device 100)including the accelerometer and the optical sensor can be used bymultiple people. A calibration is performed for each individualfollowing the process 1200 and a set of calculated parameters are storedin association with the corresponding person. The device mayautomatically choose a set of stored parameters for use with anindividual based on biometric identifications of the individual, or mayask the individual to self-identify and choose the correct set ofparameters for use, in case the device is shared among multiple users.

After the calibration, blood pressure measurements based on continuouslyacquired data can be made available for each individual by convertingthe MPTT and SV into systolic and diastolic pressures as describedabove.

In some implementations, the systolic and diastolic pressures can alsobe calculated by adding time-varying parameter estimations based onsecond order parameters. For example, the diastolic pressure can becalculated as:

Dia=B+A*ln(MPTT)+D*f(HR)+E*g(temperature)

where f(.) and g(.) are predetermined functions, and the parameters Dand E are time dependent and individual dependent. The parameters can becalibrated when at least two calibration points (e.g., two known sets ofsystolic and diastolic pressures) at different times are available.

Generally, the calibrated parameters do not change frequently. Theseparameters may be affected by arterial diameters, arterial wallthicknesses, arterial lengths, arterial elasticity, and other physicalparameters related to the cardiovascular system of a human body. Themajority of the volume of blood related to MPTT travels through largearteries, and is less susceptible to hydrostatic changes, temperature,or peripheral tone. Curves representing relationships between MPTT andblood pressure are illustrated in FIG. 13. As seen from this example,while the curves may differ from one person to another, the generalshapes of the curves are similar.

Because multiple calibration points for a given person appear to remainon the corresponding curve, consistent data may be obtained for areasonably long time after one calibration. With the system beingcalibrated around the reference ‘normal’ blood pressure values, if theuser's blood pressure deviates from the original calibration values overtime, the device will correctly identify that the BP values aredifferent but with reduced accuracy. At that point the device may alertthe user that calibration is required. In some cases, the device may notrequire recalibration for several months. As an example, FIG. 14illustrates systolic pressure measured over 90 days after a singlecalibration, and in the absence of any additional recalibration.

In addition to using the PPG data and accelerometer data (e.g., MoCGdata) discussed above to determine certain vital signs (e.g., bloodpressure (BP), HR, HRV, respiratory rate, blood oxygen levels, SV, andcardiac output (CO)) of the wearer of the device, a processor (e.g., aprocessor of the computing device 115 (shown in FIG. 1B), or of anexternal computing device to which the PPG data and the MoCG data istransmitted) can be programmed to use this data to detect or predictcertain health-related conditions.

Detection of Irregular Heart Rhythms

The processor can be programmed to use the PPG data and accelerometerdata to detect arrhythmia or irregular heart rhythms, such as arterialfibrillation (AFIB) or atrial flutter. FIGS. 15A-15D shows graphs inwhich heart rate data of the wearer of the device 100 is plotted. Thegraphs show heart rate data plotted over a 24 hour period (FIG. 15A),during the day (FIG. 15B), and during the night (FIG. 15C).Specifically, each of these graphs includes R wave to R wave interval(RR_(i)) along the x-axis and RR_(i+1) along the y-axis. The plotteddata can be used to determine whether the subject has a normal heartrhythm or an irregular heart rhythm, as described below. The plots canbe updated after predetermined intervals (e.g., every 5-10 minutes) inorder to capture any transient anomaly.

To populate the graphs shown in FIGS. 15A-15C, the PPG and accelerometersignals are used in the manner described above to determine theinstantaneous heart rate of the wearer for each heartbeat of the wearerover a period of time (e.g., 20 seconds). The RR values are thendetermined by examining the instantaneous heart rate curve to determinethe time between each of the successive heartbeats. Each RR value isequal to the time between two consecutive heartbeats. Each RR value(RR_(i)) is then plotted versus the subsequent RR value (RR_(i+1)).

The graphs shown in FIGS. 15A-15D represent plots of a subject with anormal heart rhythm. With a normal heart rhythm, the time between beatstends to be fairly consistent. For example, while a healthy individual'sheart rate increases as a result of certain activities, such asexercise, the heart rate tends to increase gradually over time. Thus,while the individual's heart rate may be significantly higher duringsuch activities (as compared to his or her heart rate at rest), thedifference in time between consecutive heartbeats should be fairlyconsistent over the course of a small number of consecutive heart beats.Similarly, while a healthy individual's heart rate may decreasesignificantly as he or she recovers from such activities, the heart ratetends to decrease gradually over time meaning that the difference intime between consecutive heartbeats should be fairly consistent duringsuch a recovery period. Thus, in a healthy individual, the RR_(i) vs.RR_(i+1) plot will typically be fairly linear along a diagonal, as shownin FIG. 15D.

FIGS. 16A-16C show heart rate data for individuals with different heartconditions. For example, FIG. 16A shows heart rate data taken over a 24hour period from an individual having atrial fibrillation (AFIB). FIG.16B shows heart rate data taken over a 24 hour period from an individualhaving atrial flutter, and FIG. 16C shows heart rate data taken over a24 hour period from an individual having a normal heart rhythm.Referring first to FIG. 16A, AFIB is apparent since the spread of thevarious RR data points from the expected diagonal is greater than apredetermined spread value. AFIB causes erratic beating of the heartresulting in the time between consecutive heartbeats varyingsignificantly from one pair of heartbeats to the next. It is thischaracteristic that causes the plot of RR_(i) vs. RR_(i+1) to spreadsignificantly from the expected diagonal (i.e., the diagonal plot of anindividual who has a regular heart rhythm (as shown in FIG. 16C)).

Referring now to FIG. 16B, atrial flutter can be seen by the multipleclusters of data that are offset from the diagonal. Atrial flutterresults in changes in heart rate in multiples, which produces themultiple clusters of data that are offset from the diagonal.

In addition to being programmed to detect irregular heart rhythms, suchas arterial fibrillation (AFIB) or atrial flutter, the processor can beprogrammed to alert the wearer in response to detecting such irregularheart rhythms. For example, the processor can activate an audio orvisual alarm of the device, which can, for example, instruct the wearerto seek medical attention.

An example process 1700 of detecting arrhythmia of a subject is shown inFIG. 17. A machine, such as a processor, that receives information fromthe motion sensor 105 and the optical sensors 110 of the device 100 canperform one or more steps of the process 1700. In some implementations,the machine can include the computing device 115 described above withreference to FIG. 1B. In the process 1700, initially, data in a firstdataset that represents time-varying information about at least onepulse pressure wave propagating through blood in a subject can beprocessed (1702). Data in a second dataset that represents time-varyinginformation about motion of the subject can also be processed (1704).The data can be acquired at a location of the subject (e.g., the arm orthe wrist of the subject). Arrhythmia of the subject can be detectedbased on the processed data (1706). Arrhythmia can include atrialfibrillation or atrial flutter. Processing the data can includedetermining whether a spread of plotted R wave to R wave intervalsversus next consecutive R wave to R wave intervals exceeds apredetermined spread value. Processing the data can also includedetermining whether multiple clusters of plotted data points are offsetfrom a diagonal

Detection of Arterial Stiffness

Another health-related characteristic that can be detected by the devicedescribed herein is arterial stiffness, which is an indicator forvascular health (e.g. arteriosclerosis), risk for hypertension, stroke,and heart attack. The stiffer the arteries, the faster the blood wavetravels (due to fluid dynamics) and thus the shorter the MPTT. Theprocessor can therefore be programmed to calculate arterial stiffness asa function of the pulse transit time (MPTT).

Certain conventional devices that are used to assess arterial stiffnessrequire devices to be placed at two different locations of the subject(e.g., at the carotid and leg of the subject). Thus, the devicedescribed herein, which is able to collect from a single location of thesubject all necessary data for determining arterial stiffness, tends tobe more convenient than those conventional devices.

The processor can be programmed to inform the wearer of the device ofhis or her arterial stiffness value by, for example, causing that valueto be displayed on the display of the device. In addition, the arterialstiffness value can be used as one of multiple factors for assessing theoverall health of the wearer. In some cases, for example, the processoris programmed to use arterial stiffness of the wearer to determine ahealth metric (e.g., a health score) for the wearer. The health scoremay be a numerical value. In some cases, the numerical value is between1 and 10 or between 1 and 100.

As shown in FIG. 18, the arterial stiffness of a subject tends todecrease as the activity level of the subject (e.g., the number of timesper week that the subject exercises) increases. Thus, arterial stiffnessis one parameter that can be monitored by the device and shared with theuser to track the progress of a subject involved in an exercise regimen.This can serve as positive feedback for the user in addition toconventional feedback, such as weight loss.

Detection of Sleep Conditions

The processor can also be programmed to use the PPG data andaccelerometer data to detect sleep disorders, such as sleep apnea, andto deduce sleep quality and sleep stages. Referring to FIG. 19, toanalyze the sleep of the wearer of the device, the processor firstanalyzes the low frequency components of the accelerometer data toidentify sleep rest periods (SRPs), which are periods in which theaccelerometer data is substantially flat for a minimum period of time(e.g., 90 seconds). The flatness of the accelerometer data indicatesthat the wearer of the device is not moving during the SRPs. Thus, SRPsare periods during which the wearer of the device is likely to beasleep.

FIG. 19 illustrates three separate SRPs (SRP1, SRP2, and SRP3). SRP1 andSRP2 and SRP2 and SRP3 are respectively separated from one another by abrief period of motion by the wearer of the device. However, forpurposes of analyzing the heart rate signal for sleep conditions, thethree SRPs are treated as a single sleep cycle. The processor can, forexample, be programmed to treat periods of motion that last less thanfive minutes as not interrupting a sleep cycle during which that motionoccurs.

After identifying the SRPs, the processor uses the PPG data and theaccelerometer data collected during the SRPs to calculate the averageheart rate, the standard deviation of the heart rate, the average heartrate variability (HRV), and the average activity level for each of theSRPs. In addition, the processor analyzes the complexity of the heartrate signal and the deviation from diagonal of values plotted on anRR_(i) vs. RR_(i+1) plot. These parameters can be used to confirm thatthe wearer of the device was sleeping during the SRP being analyzed andto identify certain sleep conditions and sleep disorders, as discussedbelow. In some implementations, jetlag can also be detected by analyzingheart rate during sleep. For example, an upward heart rate during sleepcan indicate a presence of jetlag, and a flat heart rate during sleepcan indicate that the subject is not jetlagged.

Because lack of motion cannot alone be used to determine whether thewearer of the device was sleeping, the processor can be programmed toconsider the average heart rate, the standard deviation of the heartrate, and the average heart rate variability (HRV) to confirm that thewearer was sleeping during the SRP being considered. For example, theaverage heart rate, the standard deviation of the heart rate, and theaverage heart rate variability (HRV) of the subject over the SRP beinganalyzed is compared to the baselines of these values in the subject. Ifthey fall below the baseline by a predetermined amount, this confirmsthat the subject was asleep during the period being analyzed.

Once the processor has confirmed during which of the identified SRPs thewearer was sleeping, the data collected during those periods can beanalyzed to provide detailed information about the wearer's sleep and todeduce the sleep quality. For example, by analyzing the PPG data and theaccelerometer data during the relevant time periods, the processor candetermine the number of hours slept by the wearer, the sleep latency ofthe wearer (e.g., the length of time that it took for the subject totransition from wakefulness to sleep), the number of times that thewearer tossed and turned, and the percent of time that the wearer wasasleep between the time that he or she went to bed and got up. In somecases, the processor can further determine the deepness of the sleep ofthe wearer during each of the SRPs. The deepness of the sleep issometimes referred to as the sleep stage. For example, if theaccelerometer detected minimal movement and the patient's heart ratevariability was a predetermined amount below the wearer's baseline heartrate during a portion of the SRP, it can be concluded that the wearerwas in a deep sleep during that portion of the SRP. If the accelerometerdetected some movement and the patient's heart rate was higher than canbe expected of a deep sleep during a portion of the SRP, it can beconcluded that the wearer was in REM sleep during that portion of theSRP. Otherwise, it can be concluded that the wearer was in a light sleepduring that portion of the SRP.

In some cases, the processor is programmed to use the above-notedparameters (e.g., the number of hours slept by the wearer, the number oftimes that the wearer tossed and turned, the percent of time that thewearer was asleep between the time that he or she went to bed and gotup, and the deepness of sleep) to derive a quality of sleep metric orsleep score. The wearer can monitor his or her sleep score over time inan effort to modify his or her sleep habits and maximize the quality ofhis or her sleep. It has been found that the use of such scores, asopposed to the various different related parameters, are more easilyunderstood by users.

In some cases, the processor can cause the device to automaticallydisplay the sleep score when the wearer is determined to have awoken.The device can determine when the wearer has awoken based on informationrelated to the SRPs. Based on characteristics related to the wearer'ssleep, information can be provided to the wearer to assist the wearer inimproving his or her sleep score. In some implementations, the wearercan be provided with a recommended sleep schedule. For example, if thewearer is determined to have been getting too little sleep, therecommended sleep schedule may suggest that the wearer go to bed earlierin the evening or sleep in later into the morning. The information canbe provided on the display of the device or on a separate device, suchas a mobile phone of the wearer.

As noted above, in addition to generally determining the quality of thewearer's sleep, the processor can detect certain sleep disorders, suchas sleep apnea. FIG. 19B illustrates the heart rate signal of the wearerduring a period of time in which the wearer experienced an episode ofsleep apnea. Referring to FIG. 19B, the heart rate signal of the weareris complex from 2:54 AM until about 3:16 AM at which time the heart rateof the wearer spikes suddenly. From 3:16 AM until about 3:30 AM, theheart rate signal is simple (i.e., includes periodicity or a repeatingpattern). The presence of a simple heart signal at least every twominutes during an SRP can be indicative of sleep apnea.

The processor can be programmed to carry out a multi-step test to detectsleep apnea. First, the processor analyzes the heart rate throughout theSRP being analyzed. If the difference between the minimum heart rate andthe maximum heart rate during the SRP is less than a threshold heartrate differential, then the processor determines that there was no sleepapnea and the test is concluded. If, however, the minimum-maximum heartrate differential exceeds the threshold heart rate differential, thenthe processor determines that sleep apnea could be the cause and acarries out a further analysis of the SRP. Specifically, the processoranalyzes the heart rate variability, the plotted RR points, thecomplexity of the signal, and the activity level of the subject duringthe SRP

If the heart rate variability is lower during the SRP than inneighboring periods, then this weighs against a finding of sleep apnea.If, however, the heart rate variability during the SRP exceeds the heartrate variability during neighboring periods, then this weighs in favorof a finding of sleep apnea.

Similarly, if the spread of data points in an RR_(i) vs. RR_(i+1) plotlargely lie along the diagonal, this weighs against a finding of sleepapnea. If, however, the data points are spread from the diagonal, thenthis weighs in favor of a finding of sleep apnea. The data points wouldbe expected to spread from the diagonal during a sleep apnea episodebecause the wearer's heart rate would drastically increase in a veryshort period of time due to lack of oxygen in the wearer's blood. Thisdrastic increase in a short period of time would translate to a largerthan normal discrepancy between the RR_(i) and RR_(i+1) values duringthat time period.

Another factor used to determine whether the wearer has sleep apnea isthe complexity of the heart rate signal. If the heart rate signal iscomplex during the SRP, then this weighs against a finding of sleepapnea. If, however, at least every two minutes, the heart rate signalbecomes simple (i.e., has periodicity or a repeating pattern), then thisweighs in favor of sleep apnea.

Activity level is another factor used to identify sleep apnea. If theactivity level of the wearer during the SRP being analyzed (asdetermined using the accelerometer data) is greater than the activitylevel of the wearer during neighboring periods, this weighs against afinding of sleep apnea. If, however, the activity level of the wearerduring the SRP being analyzed is less than the activity level of thewearer during neighboring periods, this weighs in favor of a finding ofsleep apnea.

The processor can be programmed to determine the presence or absence ofsleep apnea as a function of heart rate, heart rate variability, thelocation of data points on the RR_(i) vs. RR_(i+1) plot, the complexityof the heart rate signal, and the activity level of the subject.

In some cases, the processor can be programmed to determine acorrelation between the wearer's sleep quality and an amount of lightthat the wearer is exposed to.

FIG. 20 shows an example screenshot 2000 on a mobile phone 2002 of awearer that displays qualities of the wearer's sleep in conjunction withlight levels during various times. In this example, the wearer slept for7 hours and 52 minutes total, awoke, 4 times, and has a sleep score of74. The screenshot also includes two bars: one bar shows times when thewearer had low-quality sleep, and another bar shows the measured lightlevels during those times. In this way, a correlation is made betweenthe wearer's sleep quality and light levels experienced by the wearer.The screenshot 2000 also includes a link 2004 for the wearer to receivesleeping environment tips that can improve his or her sleep quality.

Upon detecting an episode of sleep apnea, the processor can alert thewearer that he or she may have experienced an irregular sleep pattern.

An example process 2100 of determining information about acharacteristic of a subject's sleep is shown in FIG. 21. A machine, suchas a processor, that receives information from the motion sensor 105 andthe optical sensors 110 of the device 100 can perform one or more stepsof the process 2100. In some implementations, the machine can includethe computing device 115 described above with reference to FIG. 1B. Inthe process 2100, initially, data in a first dataset that representstime-varying information about at least one pulse pressure wavepropagating through blood in a subject can be processed (2102). Data ina second dataset that represents time-varying information about motionof the subject can also be processed (2104). The data can be acquired ata location of the subject (e.g., the arm or the wrist of the subject).The information about at least one pulse pressure wave propagatingthrough blood in the subject can include photoplethysmographic (PPG)data, and the information about motion of the subject can include one orboth of motioncardiogram (MoCG) data and gross motion data. Based on thedata, information about a characteristic of the subject's sleep can bedetermined (2106). The characteristic can include a quality of the sleepof the subject. The quality of the sleep of the subject can include oneor more of a sleep duration, a sleep latency, a sleep staging, latencyto sleep, a number of disturbances, and a number of tosses and turns.The characteristic of the subject's sleep can also include sleep apnea.

Fitness-Related Applications

The processor can also be programmed to perform various fitnessapplications that allow the wearer to monitor his or her fitness level.As an example, the processor can be programmed to analyze theaccelerometer data over a given period of time (e.g., 15 minutes) todetermine the total number of steps taken by the wearer during thattime. The processor is programmed to look for rhythm/cadence to detectwalking as opposed to other ordinary motion, such as hand motions andvibrations. The absolute value of the accelerometer data will typicallybe higher during periods of walking that during periods of most otherdaily activities.

In addition, the processor can calculate calories burned over a givenperiod of time by analyzing the activity level of the wearer and/or theheart rate of the user. Using both the activity level and the heart rateto determine calories burned can lead to a more accurate estimation ofcaloric output.

In some cases, the processor is programmed to provide a fitness scorebased on certain fitness-related parameters, such as resting heart rate.The more fit an individual is, the lower his or her baseline HR will be.Thus, in some cases, the processor is programmed to determine a fitnessscore based on the average heart rate of the wearer during sleep periodsor periods of inactivity. Additionally, the speed of heart rate recoverycan be a strong indicator of a person's fitness level. For example, themore fit an individual is, the faster his or her heart rate returns tothe baseline after exercising. Similarly the more fit an individual is,the longer it takes for his or her heart rate to increase duringexercise. Thus, in certain cases, the processor is programmed todetermine an individual's fitness score based on the amount of time thatit takes for the individual's heart rate to reach a maximum duringexercise and the amount of time that it takes for his or her heart rateto return to the baseline after exercise.

In some cases, the processor can cause the device to automaticallydisplay the fitness score when the wearer is determined to be in thefitness state. For example, the fitness score may be displayed when thewearer starts to go for a run, and may be displayed throughout the run.In some implementations, the fitness score may be displayed when thewearer transitions from a fitness state to a non-fitness state. Forexample, the fitness score may be displayed when the wearer finishes arun. In some implementations, the device can determine when the weareris in the fitness state based on the gross motion data and the vitals ofthe wearer, such as the wearer's heart rate. Based on characteristicsrelated to the wearer's fitness, information can be provided to thewearer to assist the wearer in improving his or her fitness score.

FIG. 22 shows an example screenshot 2200 displaying a fitness score on amobile phone 2202 of a wearer. The information on the screenshotindicates that the wearer has improved his or her fitness score by twopoints. The screenshot also provides the wearer with updatedpersonalized training zones. The personalized training zones representthe heart rate that the wearer should strive to achieve under variousexercise conditions. For example, if the wearer is performing extremeexercise, he or she should strive to have a heart rate of more than 151beats per minute.

In some implementations, the wearer can be provided with a recommendedfitness routine. For example, it may be determined that the wearer hastrouble completing a three-mile run, as indicated by an abnormally highheart rate during the run. The recommended fitness schedule may suggestthat the wearer run one mile twice a week for a week in order to improvehis or her fitness, thereby allowing the wearer to work up to a fitnesslevel appropriate for safely completing a three-mile run. Theinformation for assisting the wearer can be provided on the display ofthe device or on a separate device, such as a mobile phone of thewearer.

In some implementations, the device may have access to other users'vital information and fitness scores, such that a wearer of the devicecan compare his or her fitness score to those of other people. Forexample, a professional athlete who uses the device while trainingexhibits particular vital information and fitness scores. A wearer ofthe device may want to follow the same training regimen as the one thatthe professional athlete follows. However, following the same trainingregimen does not necessarily produce the same results. For example, awearer of the device may follow the same training regimen as aprofessional athlete, but he may not exhibit the same level of effort asthe professional athlete. By gaining access to the professionalathlete's vital information and comparing it to the wearer's vitalinformation, the device can determine the degree of similarity betweenthe wearer's training level and the professional athlete's traininglevel.

In some implementations, vital information of a professional athletefrom when the athlete performed or is performing a particular trainingroutine is presented to the wearer while the wearer performs the sametraining routine. For example, a video showing the athlete performingthe training routine can include a visual indication of the athlete'sBP, HR, and respiratory rate over the course of the training routine. Asthe wearer performs the same training routine while watching the video,the wearer can determine whether he or she is experiencing a similar BP,HR, and respiratory rate as the athlete, thereby indicating whether thewearer is training with the same intensity as the athlete. The video maybe configured to interact with the device such that the video encouragesthe wearer to try harder if the wearer's intensity is below that of theathlete. Similarly, after training, the device can continue to monitorthe BP, HR, and respiratory rate of the wearer to determine whether thewearer is physically recovering as well as the athlete.

The vital information of the professional athlete can be used todetermine the athlete's physical state at particular times duringcompetition. For example, the athlete's vital information can representhow the athlete physically feels while completing the last 20 meters ofa 100 meter dash, or while catching a game-winning touchdown as timeexpires. A wearer may desire to recreate this feeling for himself orherself. In some implementations, the device is configured to assist thewearer in recreating similar competition situations. For example, theathlete's vital information may indicate that a wide receiver had aparticular BP, HR, and respiratory rate while catching a game-winningtouchdown in a championship game. The particular BP, HR, and respiratoryrate may be significantly higher than they typically would be due to theintensity and importance of the game situation. In order to recreate thesituation, a wearer cannot simply go to a local football field and catcha pass from a friend because the wearer would not be in the samephysical state that the wide receiver was in at the time of the catch.Rather, the user needs to match the wide receiver's BP, HR, andrespiratory rate before recreating the catch. The wearer may performvarious actions or activities to artificially match the wide receiver'svitals (e.g., running, listening to loud or exciting music, etc.). Whenthe wearer has achieved a physical state that matches the athlete's, thedevice can alert the wearer. At that point, the wearer can recreate thegame situation with improved accuracy.

In some implementations, the wearer can recreate the game situation withthe aid of a virtual reality device, such as a stereoscopic device thatcreates a computer-simulated environment. For example, the stereoscopicdevice can be used to aid the wearer in artificially matching his or hervitals with the athlete's by presenting to the wearer the same visualsand sounds that the athlete experienced before the game situation. Oncethe wearer has achieved a matching physical state, the stereoscopicdevice can also be used to recreate the particular game situation orplay. That is, rather than catching a real football from a real person,the stereoscopic device can display visuals that simulate the action ofcatching the game-winning touchdown.

Concepts similar to those described above can also apply in the contextof combat training. A person in a real combat situation typicallyexhibits increases in BP, HR, and respiratory rate due to the danger ofthe situation. Training for these situations does not involve the samerisk of danger. Thus, such training is typically not performed under thesame physical conditions. That is, a trainee does not have the same BP,HR, and respiratory rate that he would otherwise have in a real combatsituation. In some implementations, a person's vital information can beused to determine the person's physical state at particular times duringa real combat situation. For example, a Navy SEAL may exhibit aparticular BP, HR, and respiratory rate while performing a raid of aterrorist hideout. A trainee who is wearing the device may performvarious actions or activities to artificially match the Navy SEAL'svitals. When the trainee has achieved a physical state that matches theNavy SEAL's, the device can alert the trainee, who can then recreate atraining scenario with improved accuracy.

Monitoring Stress Levels

The processor can also be programmed to analyze the PPG data and theaccelerometer data in a way to determine the stress level of the wearerof the device. Heart rate (HR), heart rate variability (HRV), bloodpressure (BP), and respiratory rate are all indicators of stress.Specifically, the values of these parameters increase as stress levelsincrease. Thus, by comparing these values to baseline values of thewearer for associated parameters, the level of stress of the wearer canbe estimated. The stress level can, for example, be provided to thewearer as a stress score.

In some cases, the processor can cause the device to automaticallydisplay the stress score when the wearer is determined to be in a stressstate. The device can determine when the wearer is in a stress statebased on the vitals of the wearer, such as the wearer's heart rate,heart rate variability, blood pressure, and respiratory rate. Based oncharacteristics related to the wearer's stress, information can beprovided to the wearer to assist the wearer in improving his or herstress score. In some implementations, the wearer can be provided with arecommended stress-reducing routine. For example, the recommendedstress-reducing routine may suggest that the wearer meditate atparticular times (e.g., once a day) or adjust his or her daily scheduleto minimize circumstances that are generally attributed to stress (e.g.,sitting in traffic, working too much, etc.). The information can beprovided on the display of the device or on a separate device, such as amobile phone of the wearer.

FIG. 23 shows an example screenshot 2300 on a mobile phone 2302 of awearer that includes a number of stress moments experienced by thewearer. In this example, the wearer has experienced four stress momentson the current day. A graph indicates the number of stress moments thatthe wearer has experienced throughout the week. The screenshot includesrecommendations for the wearer to reduce his or her stress. In thisexample, the screenshot recommends that the wearer plan some rest,relaxation, and/or a meditation session to reduce stress. The screenshotalso includes a link 2304 to a 1-minute relax sessions, during which themobile phone guides the wearer on a relaxation session.

An example process 2400 of deriving information about a psychologicalstate of a subject is shown in FIG. 24. A machine, such as a processor,that receives information from the motion sensor 105 and the opticalsensors 110 of the device 100 can perform one or more steps of theprocess 2400. In some implementations, the machine can include thecomputing device 115 described above with reference to FIG. 1B. In theprocess 2400, initially, data in a first dataset that representstime-varying information about at least one pulse pressure wavepropagating through blood in a subject can be processed (2402). Data ina second dataset that represents time-varying information about motionof the subject can also be processed (2404). The data can be acquired ata location of the subject (e.g., the arm or the wrist of the subject).Information about a psychological state of the subject can be derivedfrom the processed data (2406). The psychological state of the subjectcan be a state of stress, a malicious intent, or a state of lying.Relationships between at least some of the processed data and apsychological state of the subject can be inferred.

Health Metrics

As described above, one or more scores, also referred to as healthmetrics, can be derived based on data collected by the device 100. Amachine, such as a processor, that receives information from the opticalsensors 110 of the device 100 can perform one or more steps of theprocess. In some implementations, the machine can include the computingdevice 115 described above with reference to FIG. 1B. Operations of theprocess can include deriving a score that is associated with a state ofa subject. The state of the subject can be one or more of a healthstate, a sleep metric, a fitness state, and a stress state. Deriving thescore can be based on data in a first dataset that representstime-varying information about at least one pulse pressure wavepropagating through blood in the subject. The data can be acquired at alocation of the subject (e.g., the arm or the wrist of the subject).Deriving the score can also be based on data in a second dataset thatrepresents time-varying information about motion of the subject. Themachine can receive information from the motion sensor 105 of the device100.

Triage Applications

The data produced by the device can be used to assist triage medicalpersonnel in various settings. As an example, the device could be wornby military personnel in battle to provide medical personnel withvaluable information regarding the vital signs of the militarypersonnel. The devices worn by the military personnel can, for example,be configured to transmit data regarding their vital signs to a centralcomputer manned by medical personnel. In the event that that multiplecasualties are suffered at the same time, the medical personnel can viewthe vital signs of the various military personnel to prioritize medicalcare. As a result, the people that most need urgent treatment willreceive it first, while those who have less threatening injuries will beattended to later.

In addition to being used for military personnel, the devices describedherein could be used to assist medical personnel in various other triagesettings, such as sites of natural disasters or terrorist attacks. Forexample, the medical personnel could be provided with a number ofdevices that could be put on patients in the triage setting as thosepatients are being assessed. In this way, after the medical personnelhave performed an initial assessment of a victim and determined that heor she does not require urgent medical care, the medical personnel canleave that victim and focus their efforts on victims in more urgent needof medical care. While doing so, the vital signs of those victims whowere initially assessed and determined not to require urgent medicalcare will be monitored and transmitted to a central monitoring station.Thus, in the event that the condition of one of those victims beingmonitored deteriorates to the point of requiring urgent medicalattention, medical personnel in the area can be directed to that victimto provide the necessary medical care.

A machine, such as a processor, that receives information from theoptical sensors 110 of the device 100 can perform a process for riskassessment. In some implementations, the machine can include thecomputing device 115 described above with reference to FIG. 1B. Theprocess can include processing data from a first dataset that representstime-varying information about at least one pulse pressure wavepropagating through blood in the subject. The data can be acquired at alocation of the subject (e.g., the arm or the wrist of the subject).Data in a second dataset that represents time-varying information aboutmotion of the subject can also be processed. The machine can receiveinformation from the motion sensor 105 of the device 100. The data canbe acquired while the subject is in a situation associated with risk.Whether the subject is in a situation associated with risk can beindicated by the data. The risk can be trauma to the subject, and thedata can be indicative of the existence of the trauma.

In additional to being used in the triage context, the devices describedherein could be used to assist medical personnel in a hospital setting.Once a patient is stabilized following triage, he or she is typicallymonitored based on a provider's standard of care or mandate (e.g.,according to an accountable care organization (ACO)). In someimplementations, the device can continue to monitor the vital signs ofthe patient outside of the triage context to ensure that the care thatthe patient is receiving is appropriate in view of the patient's vitals.A provider's standard of care may require a patient to go through aprogression of steps before the patient is deemed to be ready fordischarge. The device can monitor the vital signs of the patient duringeach step of the progression. For example, the first step of theprogression may involve monitoring the patient's vitals while thepatient is resting (e.g., lying down and/or sleeping), the second stepof the progression may involve monitoring the patient's vitals while thepatient is sitting up in bed, the third step of the progression mayinvolve monitoring the patient's vitals while the patient is standing upwhile being supported, the fourth step of the progression may involvemonitoring the patient's vitals while the patient is standing upunassisted, and the fifth step of the progression may involve monitoringthe patient's vitals while the patient is walking. The devicecontinuously monitors the patient's vitals throughout each of thesestages and can present a notification if the vitals indicate that thepatient is in a dangerous state (e.g., if the patient is progressingthrough each step too quickly without giving his or her body a chance torecover). In this way, the device monitors the patient's compliance withthe provider's standard of care.

In some implementations, the patient's vitals can also serve as anindicator of the quality of care that the patient is receiving at a carefacility. For example, the device can monitor the vitals of residents ata nursing home to determine the level of activity that the residents areexperiencing. Data from the motion sensor of the device may indicatethat the residents typically walk or perform other exercises one hourper day, and data from the ultraviolet light sensor of the device mayindicate that the residents typically spend two hours per day outdoors.The monitored vitals can be compared to metrics defined by a healthorganization (e.g., the American Heart Association) to determine whetherthe residents are adhering to the organization's recommendationsregarding physical activity and other health-related actions. Theresidents' level of compliance with the organization's recommendationscan be used to assess the quality of care at the nursing home. In someimplementations, the nursing home may be assigned a quality score basedon the monitored vitals and the level of compliance with theorganization's recommendations, and multiple nursing homes may becompared and/or ranked according to their quality scores. Similarconcepts can also apply in the context of child care.

An example process 2500 of determining a quality of care provided to theone or more subjects by a care facility is shown in FIG. 25. A machine,such as a processor, that receives information from the motion sensor105 and the optical sensors 110 of the device 100 can perform one ormore steps of the process 2500. In some implementations, the machine caninclude the computing device 115 described above with reference to FIG.1B. In the process 2500, initially, data that represents time-varyinginformation about at least one pulse pressure wave propagating throughblood in each of one or more subjects can be processed (2502). Data thatrepresents time-varying information about motion of the one or moresubjects can also be processed (2504). The data can be acquired at alocation of the subject (e.g., the arm or the wrist of the subject). Aquality of care provided to the one or more subjects by a care facilitythat cares for the one or more subjects can be determined (2506).Determining a quality of care can include determining a level ofphysical activity experienced by each of the one or more subjects. Thelevel of physical activity can be determined by comparing gross motiondata gathered by the motion sensor 105 to a threshold. Data thatrepresents information about an amount of ultraviolet light that each ofthe one or more subjects has been exposed to over a particular timeperiod can also be processed, and an amount of time that each of the oneor more subjects has spent outside can be determined.

First Responder Applications

The devices described herein can also be beneficial to first responders,such as firefighters and police offers. By wearing the devices, thefirst responders will ensure that their vital signs are monitoredbefore, during, and after any stressful events that they experience toensure that they receive the help they need. This is illustrated in theexample of FIG. 26, where health parameters of one or more firefighters2605 on a potentially hazardous mission are obtained via devices 100worn or carried by the firefighters 2605. In this example, thefirefighters' vital signs could be obtained by the devices 100 andtransmitted to a central monitoring station (e.g., within a fire truck2610, or at a fire station) where the vital signs can be monitored todetermine whether the firefighters 2605 are well enough to continuefighting a fire or otherwise responding to an emergency. In the eventthat a firefighter's health is considered to be in jeopardy based on hismonitored vital signs, that firefighter could be prevented fromcontinuing to fight the fire or respond to the emergency, for example,by sending an alert to the firefighter 2605 to retreat to a safelocation.

In certain implementations, the devices 100 worn or carried by thefirefighters 2605 further include GPS transponders. Such devices areparticularly beneficial for situations in which one or more firstresponders 2605 become incapacitated in a dangerous setting. Forexample, in the event that a firefighter 2605 has a heart attack whilefighting a fire inside a building, the device could not only send thefirefighter's vital sign data to the central monitoring station to alertsomeone that the firefighter is in need of medical care, the devicecould also identify the location of the firefighter 2605 to a rescuer2620 (possibly via a device 100) sent to assist the incapacitatedfirefighter 2605, such that the rescuer 2620 knows exactly where to go.

The communications about the health parameters of the one or morefirefighters 2605 can be sent directly to the central monitoringstation, or via a server 2630. In some implementations, if the server2630 determines that a firefighter's mental/physical state is notsuitable for continuing the mission, the server 2630 can send a signalto the firefighter (e.g., via the device 100, or via anothercommunication device) to alert the firefighter 2605 about the situation.For example, if the health condition of the firefighter deterioratesduring the mission (e.g., because of excessive smoke inhalation), asignal can be sent to the device 100 to alert the firefighter to takecorrective measures.

In some implementations, the device 100 can be configured to communicatewith the central monitoring station on the fire truck 2610. The datafrom the devices 100 can be transmitted to the server 2630 (possibly viathe central monitoring station) for determining whether a firefighter2605 is safe. The determination can also be made at the centralmonitoring station. The data from the device 100 may also indicatewhether the wearer of the device 100 requires assistance from a rescuer2620. The server 2630 and/or the central monitoring station can thenalert the firefighter 2605 and/or a rescuer 2620 accordingly. In someimplementations, if another individual (i.e., someone not in thefirefighting team) is wearing a device 100, his/her location may also betracked using information transmitted from the corresponding device.

Alertness Monitoring

The processor can also be programmed to monitor the alertness of thewearer. This can be particularly advantageous for personnel who performtasks that require attention and concentration, and could result inserious harm or danger if carried out incorrectly. Examples of suchpersonnel include air traffic controllers, pilots, military truckdrivers, tanker drivers, security guards, TSA agents, intelligenceanalysts, etc.

To monitor the alertness of the wearer, the processor can analyze therespiratory rate, heart rate, blood pressure, and activity level of thewearer. Each of these parameters tends to decrease as a subject fallsasleep. Thus, the processor can be programmed to conclude that thewearer's alertness level has dropped to an unacceptable level when oneor more of those parameters falls a predetermined amount from thebaseline of those parameters.

The processor can be programmed so that, upon determining that thewearer's alert level has dropped to an unacceptable level, an alarm(e.g., an audible, visual, or tactile alarm) on the device is activated.The alarm can raise the alertness level of the wearer and thus reducerisk of harm to the wearer and others.

As noted above, some wearers that may benefit from this application ofthe device are those wearers that drive vehicles or operate machinerythat could present a danger if driven or operated incorrectly. In thosecases, the processor can be configured to communicate with the vehicleor machinery for which the wearer is responsible. As an example, thedevice worn by a truck driver can transmit data regarding his or heralertness level to a controller of the truck. The controller can beconfigured to disable operation of the truck if the alertness level isbelow an acceptable threshold. For example, the controller can warn thedriver that he or she has a certain period of time to pull the truckover before it is disabled. This will encourage the driver to pull offthe road and either get some sleep or otherwise increase his or heralertness level before driving the truck again.

As an alternative to or in addition to taking the actions discussedabove in response to detecting a potentially unsafe alertness level, thealertness data can be stored in a database for later analysis. Studyingthe alertness data from a large sampling of personnel in a givenindustry can help regulatory bodies for those industries to draft safetystandards that increase or maximize safety while maintainingproductivity.

Similarly, alertness data over a period of time for a particular wearerof the device can be analyzed to determine the overall physical and/ormental state of a given wearer (e.g., as opposed to the instantaneousstate of the given user). Such information can be used to detect a trendof regressing physical and/or mental state of the given wearer. Forexample, although a wearer of the device may exhibit vitals thatindicate that he is alert enough to perform a particular task (e.g., flya plane) at a particular time, the wearer's alertness data over a periodof time may indicate that the wearer's general alertness is on thedecline. This may be due to the wearer's old age. The device can detectsuch a trend and alert the wearer and/or an external entity that thewearer should be closely monitored.

In some implementations, a process can be configured to acquire datawhile a subject is in a situation that requires a predetermined amountof alertness of the subject. A machine, such as a processor, thatreceives information from the optical sensors 110 of the device 100 canperform one or more steps of such a process. In some implementations,the machine can include the computing device 115 described above withreference to FIG. 1B. Operations of the process can include processingdata in a first dataset that represents time-varying information aboutat least one pulse pressure wave propagating through blood in thesubject. The data can be acquired at a location of the subject (e.g.,the arm or the wrist of the subject). The operations can also includeprocessing data in a second dataset that represents time-varyinginformation about motion of the subject. The machine can receiveinformation from the motion sensor 105 of the device 100. The data canbe acquired while the subject is in a situation that requires at least apredetermined amount of alertness of the subject. The situation caninclude one or more of air traffic control, intelligence analysis,vehicle driving, machinery driving, security guarding, baggagescreening, and aircraft piloting.

Detection of Malicious Intent

The devices described herein can also be used as polygraph devices. Likeconventional polygraph devices, the devices described herein gather abaseline for the wearer's vital signs (e.g., respiratory rate,electrical skin impedance, heart rate, heart rate variability, and bloodpressure) and those baselines can later be compared to associated vitalsigns recorded during questioning. Because the devices described hereinare wearable, untethered, and non-cumbersome, and thus do not reduce themobility of the wearer, the individual being tested can be required towear the device for a specified period of time (e.g., 24 hours) beforeand after questioning without hindering the normal, everyday activitiesof the individual. As a result of the long period of time for which thesubject wears the device, the baselines for the subject's vital signscan be more accurately determined. For example, it is less likely thatthe subject could artificially adjust his or her vital baselines due tothe large amounts of data collected to form those baselines. Therefore,the accuracy of the polygraph test can be increased relative to certainconventional polygraph devices.

In addition to monitoring the above-noted vital signs of the subjectdetermine whether the subject is answering questions truthfully, theaccelerometer data can be analyzed to identify movements or lack ofmovements that may indicate that the subject is lying. It is believed,for example, that individuals freeze for a moment when they are caughtdoing something wrong. In the case of polygraph examinations, it isbelieved that a subject will freeze when asked a question about thesubject's wrongdoing. Thus, by analyzing the accelerometer data of thedevice, it is possible to identify those times during questioning thatthe subject freezes. This information can be used to further assess thetruthfulness of the subject's response during that time.

Readiness Detection

In addition to those applications discussed above, the processor can beprogrammed to analyze the PPG data and the accelerometer data todetermine the physical and mental readiness of a subject to perform acertain task. General fatigue and stress, which can result in a drop inphysical and mental readiness, is generally evidenced by an increase inrespiratory rate, heart rate, and blood pressure. Thus, in order todetermine a wearer's physical and/or mental readiness, the processor canbe programmed to analyze the wearer's respiratory rate, heart rate, andblood pressure and to indicate a state of unreadiness if thoseparameters fall a certain amount below the baseline for thoseparameters. In certain cases, the processor is programmed to alsoconsider other factors in this readiness assessment, including thequality of the wearer's sleep (e.g., the wearer's sleep score) over aperiod of time (e.g., 24 hours or 48 hours) leading up to theassessment.

The determination of readiness of wearers of the device can assistleaders of those wearers with maximizing his or her human resourcesduring taxing situations. For example, military leaders can analyze thedata of soldiers in their units to determine which of those soldiers ismost physically and mentally able to successfully carry out a missionand can staff the mission accordingly. Similarly, coaches may analyzethe data of their team members to determine which of those athletes arebest physically and mentally fit to play at their top level at any giventime during a competition and can use those players that are able toperform at their top level.

In some implementations, the physical and mental readiness of a subject,as well as motion sensor data and information related to other factors,can be used by the device to predict a winner of a competition. Forexample, by analyzing vital signs (e.g., BP, HR, respiratory rate) ofthe contestant before and during a track race, a change in physical andmental readiness can be inferred. The device can also considerinformation such as the force exerted against the ground by thecontestant and the velocity of the contestant at various points duringthe race to determine a likelihood that the contestant will win therace. The contestant's device can also consider similar informationrelated to other contestants in determining the likelihood that thecontestant will win the race. For example, the device may determine thata first contestant got off to a quicker start than a second contestantin a 100 meter dash based on collected motion data. Historical data mayindicate that the contestant who is “first out of the blocks” has a 65%chance of winning the race. Thus, the device can predict the winner ofthe race within milliseconds of the start of the race.

In some implementations, the device can monitor a contestant'sperformance at an infinite number of intervals while correlating thecontestant's performance to the measured vitals. During a one mile trackrace, a contestant typically keeps track of his lap times for each ofthe four laps. However, the contestant does not typically have access tomore detailed data, such as his or her performance over the first 100meters, the last 100 meters, at various points in the middle of therace, etc. The device can be configured to keep track of thecontestant's performance at any time or range of times during the race,and can also correlate the contestant's performance to the vitalsmeasured by the device. For example, the contestant may complete thefirst lap of the mile in 50 seconds, putting him or her on pace toeasily break the world record. However, the device may determine thatthe contestant has a BP, HR, and respiratory rate significantly higherthan what would typically be seen in someone who has only completed 25%of the race, and thus determine that the contestant likely will not winthe race. By exhibiting so much effort early in the race, the contestantburns out and finishes the race with a mediocre time. In someimplementations, the contestant can use the performance data and themeasured vitals to improve his or her training in the future. Forexample, the next time the contestant runs a mile, the device may detectthat the contestant is exhibiting too much effort early in the race bymeasuring a high BP, HR, and respiratory rate. The device can beconfigured to notify the contestant to reserve energy in order tooptimize his or her performance.

Similarly, in some implementations, the device can be used to monitorthe performance of an entire team of individuals wearing the device. Forexample, the collective physical and mental readiness of a footballteam, as well as motion sensor data and information related to otherfactors, can be used to determine whether the football team isperforming to its potential. Information related to the vitals of afirst team, such as the team's collective BP, HR, and respiratory rate,may indicate that the first team is exhibiting a large amount of effort.Information related to the vitals of a second team may indicate that thesecond team is exhibiting minimal effort. However, the second team iswinning the football game against the first team, indicating that thefirst team may have inferior technique or coaching. Such information canbe used during training to indicate areas where the team needs toimprove their technique. Information related to a team's vitals can alsobe used to ensure that the team does not exhibit too much effort earlyin the season, thereby making it susceptible to “burning out” towardsthe end of the season.

An example process 2700 of providing information to a user that reportsrelative states of subjects is shown in FIG. 27. A machine, such as aprocessor, that receives information from the motion sensor 105 and theoptical sensors 110 of the device 100 can perform one or more steps ofthe process 2700. In some implementations, the machine can include thecomputing device 115 described above with reference to FIG. 1B. In theprocess 2700, initially, data that represents time-varying informationabout at least one pulse pressure wave propagating through blood in eachof two or more subjects can be processed (2702). Data that representstime-varying information about motion of the two or more subjects canalso be processed (2704). The data can be acquired at a location of thesubject (e.g., the arm or the wrist of the subject). Information can beprovided to a user that reports relative states of the subjects (2706).The information can be based on the processed data. The relative statesof the subjects can include one or more of relative psychologicalstates, relative physical states, and relative states of readiness. Thesubjects can be put into an athletic contest or assigned a particularcombat task according to the relative states of the subjects.

Correlation between Impact Force and Vitals of Multiple Users

In some implementations, the processor can be programmed to analyze thevital signs of multiple users in the moments leading up to a collision.For example, when two players collide during a sporting competition, alarge amount of force is absorbed by each player. Force data can bemeasured by the motion sensor of the device, and the device candetermine the magnitude of force absorbed by each player. The device candetermine the effect of the force on each player by analyzing theplayers' vitals (e.g., BP, HR, respiratory rate, body temperature)before, during, and after the collision. The vitals and the forceinformation can be used to determine whether a player has sustainedbodily damage due to the impact force. For example, if a playerexperiences a sudden increase in HR, respiratory rate, and bodytemperature following a collision, it may be an indication that theplayer has sustained a concussion.

In some cases, a player's bodily reaction to sustaining a concussion isdelayed. For example, a player may experience a sudden increase in HR,respiratory rate, and body temperature at some time following acollision, or the player may experience a gradual increase in HR,respiratory rate, and body temperature beginning at the time of thecollision. The device can monitor the player's vitals for an extendedtime following the collision and compare the monitored vital informationto vital information of a player who was previously diagnosed with aconcussion. In this way, the device can determine vital patterns thatare indicative of a person who sustains a concussion. If the devicedetermines that a player has sustained a concussion, the device may beconfigured to alert the player or a third party. The player may berequired to pass a protocol before reentering the game. If the devicedetermines that there is a possibility that the player has sustained aconcussion, the device may enter a mode where the player is monitoredmore closely in order to make a more definitive determination.

Human Flight Recorder

The devices described herein can also be used as human flight recorders.While accident investigators (e.g., National Transportation Safety Board(NTSB) investigators) have traditionally been limited to analyzing voicerecorders and, in some cases, black boxes, after airplane and traincrashes, the devices described herein, when worn by the operators ofthose vehicles, will provide insight into the state of the operator atthe time of the crash. For example, by analyzing vital signs of theoperator (e.g., the respiratory rate, heart rate, heart ratevariability, and blood pressure of the operator) in the moments leadingup to the crash, the investigators can learn whether the operator fellasleep, experienced some form of medical emergency, etc. Thisinformation is valuable for the investigators to determine whether thecrash was the result of the operator's actions as opposed to some otherreason, such as mechanical failure.

For example, in the context of a car accident, information related tothe vital signs of the operator as well as information related to theoperating characteristics of the car (e.g., the speed, direction, andbreaking, as measured by other sensors) can be used to determine thecause of the accident, the mechanism of injury to the operator, and theimpact of the injury to the operator. In this way, the mental and/orphysiological state of the operator before, during, and/or after theaccident can be ascertained. The 60 minutes following a traumatic injuryis generally referred to as the “golden hour,” during which there is thehighest likelihood that prompt medical treatment will prevent death. Itis especially important to quickly gather vital information during thistime to assist first responders and doctors in diagnosing and treatingthe operator.

In some implementations, the human flight recorder information can beused by third parties to determine who was at fault in creating theaccident. For example, a law enforcement body may analyze the humanflight recorder information to determine whether a tort or a crime wascommitted by an operator. In some implementations, the human flightrecorder information can be used to determine an exact time when anevent occurred. For example, the information can be used to determine anexact time of death, an exact time when a person went missing (e.g., bybeing abducted), or an exact time when a person fell down.

Similarly, after a wearer of the device experiences a period of illnessor discomfort, the data could be analyzed by his or her physician tohelp diagnose the condition. For example, if a wearer has a heartattack, the data could be analyzed to investigate the variation in thevital signs leading up to the attack. Other data can also be considered,such as the wearer's genetics, epigenetics, diet, exercise practice, andenvironmental circumstances surrounding the event or condition. Thisinformation may be correlated and used to prevent onset of similarconditions in the future, for example, by alerting the user of such apossibility upon detecting similar variations in vital signs.

In some implementations, the device is able to determine a “baselinebiorhythm” of a wearer based on the wearer's vital signs in variouscircumstances and environmental environments. The baseline biorhythm istypically unique to each individual. Once the baseline biorhythm isestablished and substantially refined, the device is able to detect whenthe wearer's vital signs are shifting away from the baseline biorhythm.For example, the device may detect that a wearer's biorhythm hasgradually shifted over a particular time period, as indicated byvariations in the wearer's vital signs. The device may also detect thatthe wearer has spent minimal time outside over the same time period, asindicated by measurements from the device's ultraviolet light sensor.The device can identify a correlation between the wearer's changedbiorhythm and the change in ultraviolet light exposure.

In some implementations, the device can identify a correlation betweenthe wearer's changed biorhythm and changes in the weather. For example,the device can consider the wearer's location information in conjunctionwith weather information from the National Oceanic and AtmosphericAdministration to determine the type of weather experienced by thewearer over a particular period of time. The device may identify thatthe wearer experiences higher BP and HR when the weather is cold and/orrainy and determine that such weather causes increased stress in thewearer.

Detection of Temperature

In addition to using the accelerometer and optical sensor to determinevital signs of the wearer, the device can include a temperature sensorfor determining the skin temperature of the wearer and an ambienttemperature sensor for detecting the ambient temperature. The processorcan be programmed to estimate the wearer's core temperature as afunction of the measured skin temperature and ambient temperature (e.g.,based on the difference between the skin temperature and the ambienttemperature).

Prediction of Medical Events

While certain examples discussed above relate to the use of PPG data andaccelerometer data (e.g., MoCG data) to diagnose medical conditions orevents that were already experienced by the user, in certainimplementations, the processor can be programmed to use this data topredict medical conditions before they happen. For example, the heartrate, heart rate variability, and blood pressure of the wearer can bemonitored and processed by the processor to make such predictions. Oneexample of a medical event that can be predicted in a subject istachycardia. Tachycardia is when a subject's heart rate is over 100beats per minute. If a subject's heart rate is trending upwards, aprediction can be made as to when the subject will experiencetachycardia. Other examples of medical events that can be predicted arehypertension and stroke. For example, if a subject's blood pressure isincreasing over time (e.g., if the rate of change of the blood pressureis above a threshold), a prediction can be made as to when the subjectwill experience hypertension. Hypertension is diagnosed when a subject'sblood pressure exceeds 140/90 mmHg. If the increase is rapid, aprediction can be made as to when the subject will have a highlikelihood of experiencing a stroke. Similarly, if a subject's bloodpressure is decreasing rapidly (e.g., if the rate of change of the bloodpressure is negative and below a threshold), a prediction can be made asto whether the subject will have a heart condition.

In cases where the heart rate variability of the subject is used topredict a medical event, whether the subject experiences arrhythmia(e.g., atrial fibrillation) can determine what an appropriate heart ratevariability of the subject is. For example, a subject who experiencesarrhythmia may have a high heart rate variability, but this may benormal given the subject's condition.

An example process 2800 of predicting a medical event of a subject isshown in FIG. 28. A machine, such as a processor, that receivesinformation from the optical sensors 110 of the device 100 can performone or more steps of the process ##00. In some implementations, themachine can include the computing device 115 described above withreference to FIG. 1B. In the process 2800, initially, data in a firstdataset that represents time-varying information about at least onepulse pressure wave propagating through blood in a subject can beprocessed (2802). Data in a second dataset that represents time-varyinginformation about motion of the subject can also be processed. The datacan be acquired at a location of the subject (e.g., the arm or the wristof the subject). A medical event of the subject can then be predicted(2804). The medical event can be predicted based on the processed data.Medical events that can be predicted include tachycardia, hypertension,stroke, and heart condition.

Medication Compliance

The processor can also be programmed to ensure that the wearer of thedevice is adhering to a prescribed medication regimen. For example, forwearers who are prescribed blood pressure medication, the processor canbe programmed to monitor the blood pressure of the wearer and to alertthe wearer if, based on the blood pressure data, it appears that thewearer forgot to take his or her medication. The device can be used inthis manner to monitor a wearer's adherence to a prescribed medicationschedule for any of various other medications that impact the variousdifferent vital signs monitored by the device.

Medication Effectiveness

The processor can also be programmed to determine the effectiveness of amedication. For example, in the context of inhalation medications, it isunknown if generic inhalation medications have the same effectiveness asbrand name inhalation medications. One reason for this is thatenvironmental and genetic makeups are generally different between users.The processors can be programmed to monitor the heart rate and the bloodoxygenation (SpO₂) of wearers of devices who are prescribed genericinhalation medication and wearers of devices who are prescribed namebrand inhalation medication. The processors can also consider datarelated to environment and genetic makeups of the wearers. Data relatedto the effects of the inhalation medication on the wearers can be usedto determine the effectiveness of the generic inhalation medicationcompared to the effectiveness of the name brand inhalation medication.The device can be used in this manner to monitor the effectiveness ofany of various other medications that impact the various different vitalsigns monitored by the device.

In some implementations, the processor can determine a correlationbetween a particular medication's effectiveness and environmentalfactors. For example, two wearers of the device who reside in twodifferent extreme environments (e.g., Alaska and Florida) may experiencedifferent effects from the particular medication. Differences in themedication's effectiveness may be attributed to the different extremeenvironments experienced by the wearers. For example, the processor candetermine a correlation between the particular medication'seffectiveness and the environmental temperature experienced the wearer.

In some implementations, the device may identify a correlation between aparticular medication's effectiveness and other environmental factors.For example, differences in a medication's effectiveness between twousers may be attributed to the food that people generally eat in aparticular region, thereby allowing the device to identify food-druginteraction information related to the medication.

Because everyone has a different genetic makeup, different people mayrequire different dosages and dosage timings of a particular medication.For example, a person with a relatively fast metabolism may be able toincrease the effectiveness of a medication by taking multiple smalldoses of the medication over the course of the day. In contrast, aperson with a relatively slow metabolism may benefit from taking fewerlarge doses. The device can be configured to determine an optimal timingand dosage regimen for a particular wearer by monitoring the wearer'svitals while the wearer is under the influence of the medication. Forexample, a wearer may take a medication to maintain his or her bloodpressure below a particular level. After the wearer takes the generalrecommended dose of the medication, the device may determine that thewearer's blood pressure was reduced too much, and recommend that thewearer take a smaller dose the next day. The following day, the wearermay take the dosage amount recommended by the device. The device maydetermine that the wearer's blood pressure was reduced to the ideallevel, but that the wearer may need to take a second small dose of themedication to maintain his or her blood pressure at the ideal level overthe course of the day. In this way, the device can continuously refinethe wearer's dosage regimen to be custom tailored to the wearer. Thedevice can be used in this manner to determine an optimal dosage regimenfor any of various other medications that impact the various differentvital signs monitored by the device as described herein.

In some implementations, the processor can determine an optimal time fora wearer of the device to take a medication. For example, a doctortypically tell a patient to take particular medications at particulartimes of the day or under particular circumstances (e.g., in themorning, in the evening, with food, etc.). Such blanket directions donot typically apply to all patients under all circumstances. Theprocessor can monitor the vital signs of the wearer of the device todetermine the optimal time for the wearer to take the medication underthe current circumstances. The processor can consider characteristics ofthe particular medication when making the determination.

For example, the wearer of the device may take a medication that has atendency to cause the wearer to be energetic. A doctor may suggest thatthe medication be taken no later than 3:00 pm to prevent disruption ofthe wearer's sleep. By analyzing the wearer's vital signs, such as thewearer's heart rate and respiratory rate over the course of a particularday, the processor may determine that the wearer is more energized thanusual. The processor may recommend that the wearer take the medicationearlier than usual to prevent the wearer from becoming too energized andhaving his sleep disrupted later.

An example process 2900 of providing information about a medicationregimen of a subject is shown in FIG. 29. A machine, such as aprocessor, that receives information from the optical sensors 110 of thedevice 100 can perform one or more steps of the process 2900. In someimplementations, the machine can include the computing device 115described above with reference to FIG. 1B. In the process 2900,initially, data in a first dataset that represents time-varyinginformation about at least one pulse pressure wave propagating throughblood in a subject can be processed (2902). Data in a second datasetthat represents time-varying information about motion of the subject canalso be processed. The data can be acquired at a location of the subject(e.g., the arm or the wrist of the subject). Information about amedication regimen of the subject can then be provided (2904). Based onthe data, a determination can be made that the subject has potentiallymissed a dose of a medication, and a notification can be provided to thesubject indicating such. Based on the data, a reaction of the subject toa medication can be determined, and a recommended medication regimen ofthe medication can be provided to the subject based on the reaction tothe medication. The recommended medication regimen can include one ormore recommended dosage timings and one or more recommended dosageamounts, each of which corresponds to one of the dosage timings.

Connectivity with Other Devices

In some implementations, the device 100 can be configured to communicatewith other computing devices. For example, the device 100 can include atransceiver module that can send data to, and receive data from, aserver computer. In such cases, the device 100 can be configured to actas a client within a client-server architecture. The server computer canbe configured to receive and store data provided by the device 100 andshare the data with other computing devices. This is illustrated in FIG.30, which shows an example where, a hospital, nursing home, orelder-care center uses a server computer (or another central computeracting as a hub) 3030 that is configured to receive communications fromdevices 100 worn by patients or residents 3005. In such cases, theserver computer 3030 can be configured to determine, based on datareceived from a particular device 100, that the wearer of the device 100is in need of assistance. The server computer can be configured to alertappropriate personnel (e.g., medical personnel 3007) accordingly. Forexample, based on data (e.g., heart rate or blood pressure) receivedfrom a particular device 100, the server computer 3030 may determinethat the wearer of the particular device 100 is experiencing (or islikely to experience) a health-related emergency, and alert appropriatecaregivers 3007 automatically (e.g., by sending a message to a computingdevice 3040 at a caregivers' station, sending a text message or pagingmessage to the caregivers, triggering an alarm, or initiating anemergency call). In some implementations, in addition to health relatedinformation, the data received from the device 100 can includeadditional information (e.g. location data) that can be used incontextualizing the health information. For example, if the datareceived from the device 100 indicates that a patient is in a horizontalposition at 2:00 AM, the situation may be determined as normal. However,if accompanying location data (provided, for example, by a GPS unitwithin the device 100) shows that the patient is in a corridor orbathroom, the server computer may determine that a potentially dangerousevent (e.g., a fall or loss of consciousness) has occurred. In someimplementations, the device 100 itself may make such a determination andforward the information to the server computer 3030 for taking anappropriate action.

In some implementations, the device 100 can be configured to communicateover a network (e.g., a Wi-Fi network) with other devices connected tothe network. For example, the device 100 can be configured tocommunicate with a Wi-Fi enabled thermostat to facilitate control ofambient temperature based on vital signs data collected by the device100. For example, temperature data collected using the device 100 can beused to determine that the wearer is cold, and the temperature can beincreased accordingly. In another example, location data provided by thedevice 100 (possibly through a server computer) can be used to determinethat the wearer is not at home, and the thermostat can be instructed toswitch off the heating or cooling system accordingly. Location data canalso be used, for example, to determine that the wearer is returninghome, and the heating or cooling system can be switched on in advance.

Referring to FIG. 31, the device 100 (e.g., the wearable watch 3200 ofFIGS. 32A and 32B) can be configured to wirelessly communicate (e.g.,via a Bluetooth connection) with a proximity system 3100 that isconfigured to identify the location of the watch 3200. One or moreproximity sensors 3102 positioned throughout a store can monitor thelocation of the watch 3200, thus determining the wearer's tendencies inthe store. The location of the watch 3200 can be determined based on astrength of a wireless communication signal between the watch 3200 andone or more of the proximity sensors 3102. In some implementations, theproximity sensors 3102 are iBeacons™. The location information can beused to determine particular products and/or advertisements that thewearer expressed interest in. For example, the proximity system 3100 candetermine that a wearer of the watch 3200 spent a particular amount oftime at a location near a display for a newly-released smartphone 3104,thus making the inference that the wearer was examining and/orinteracting with the display and the smartphone 3104. The informationmeasured by the proximity system 3100 can be compared to vitalinformation collected by the watch 32003 during the same time period todetermine the wearer's reaction to the display and the smartphone 3104.For example, the wearer may have experienced an increase in heart rate,blood pressure, and respiratory rate while considering the display andthe smartphone 3104, thereby indicating that the wearer is interested inand/or excited about the smartphone 3104. In some implementations, thewearer's vital signs may indicate that a particular display, product,and/or advertisement scares the wearer or causes the wearer to feelstress, as indicated by the measured vital signs.

In some implementations, the device can be configured to wirelesslycommunicate (e.g., via a Bluetooth connection) with other devices.Multiple devices can create a mesh network, with each devicerepresenting a node that relays data for the network. In this manner, awearer who is in a location where other forms of communication are notavailable may still be able to communicate with the mesh network via thedevice. For example, a wearer who is in an underground tunnel may nothave access to a cellular or Wi-Fi network, but may still be able tocommunicate with devices of other wearers. Such mesh networkcommunication can be beneficial in certain emergency situations. Forexample, a wearer of the device who is performing an undergroundconstruction project may become lost and/or trapped, and the wearer maynot have access to a cellular network to call for help. However, thewearer may be able to manually notify another wearer of the emergencycondition via the mesh network of connected devices.

In some implementations, the device can detect and emergency conditionbased on the vitals of the wearer. For example, the device may detect asudden increase in blood pressure, heart rate, and/or respiratory rateand infer that the wearer is under distress. Upon such a determination,the device can be configured to automatically establish a wirelessBluetooth connection with any other devices within range in order tonotify wearers of the other devices of the emergency condition. Thewireless Bluetooth connection may be capable of relaying information toother wearers that can be used to assist the other wearers in locatingthe distressed wearer. For example, the signal strength of the Bluetoothconnection can be monitored to determine whether a potential rescuer isgetting closer to the distressed wearer.

Multiple devices 100 can be used to measure environmentalcharacteristics. In some implementations, multiple devices 100 can beconfigured to communicate with a Wi-Fi enabled thermostat to facilitatecontrol of ambient temperature in public places based on users' vitalsigns data collected by the devices 100. Temperature data collected bythe devices 100 can be used to determine that the wearers are cold, andthe temperature in the public place can be increased accordingly. Forexample, temperature data collected by devices 100 worn by users who aretogether in a room can be used to determine that at least some of thewearers are cold, and the temperature of the room can be increasedaccordingly.

Further, location data provided by the GPS transponder of the devices100 can be used to determine public places that are not occupied byusers, and the thermostat can be instructed to switch off the heating orcooling system accordingly. Similarly, location data can also be used,for example, to determine that users are about to be at a particularpublic place, and the heating or cooling system can be switched on inadvance.

In some implementations, location data and temperature data provided bythe devices 100 can be used to determine that nobody is in a particularsubway car, and the heating or cooling system in the particular subwaycar can be switched off accordingly. Similarly, location and temperaturedata provided by the devices 100 can be used to determine that one ormore users of the devices 100 are about to occupy a particular subwaycar, and the heating or cooling system of the particular subway car canbe switched on in advance (e.g., to allow the subway car to assume anappropriate temperature in advance of being occupied).

Because the data from the device 100 can be used to identify a wearer,as well as make various inferences about the state of the body(activity, tiredness, stress level, sleep pattern, etc.) and/or mind(mood, alertness, etc.) of the wearer, different types ofpersonalization can be facilitated accordingly, via communications withappropriate devices and systems. Examples of such personalization caninclude providing mood-based lighting or music and activity-basedtemperature control. In some implementations, an entertainment devicesuch as a smart TV can be configured to provide personalized suggestionsfor TV shows, movies, or games based on a state of a user's body and/ormind as determined from data received from the device 100.

In some implementations, data from the device 100 can be used to cause aparticular TV show or movie to be dynamically changed. For example, a TVshow or a movie can have multiple pre-made endings. The device 100 canconsider the wearer's vitals, such as blood pressure, heart rate, andrespiratory rate, to make inferences about the physical and/or mentalstate of the wearer. The device 100 can then cause the particular TVshow or movie to be dynamically altered based on the state of thewearer. For example, if the wearer's vitals indicate that the wearer isbored (e.g., as indicated by a reduced heart rate and/or respiratoryrate), the device 100 may cause the TV show or movie to dynamicallyadapt and play a more exciting alternate ending. On the other hand, ifthe wearer's vitals indicate that the wearer is scared or upset by thecontent of the TV show or movie (e.g., as indicated by an increase inblood pressure, heart rate, and/or respiratory rate), the device 100 maycause the TV show or movie to dynamically adapt and play a toned-downalternate ending. The device 100 can be used in a similar manner todynamically alter audio output devices (e.g., stereos or entertainmentsystems), video games, and other entertainment mediums, as described inmore detail below.

In some implementations, the device 100 can be used to facilitate accesscontrol. An example of such an environment 3300 is shown in FIG. 33. Inthe example of FIG. 33, a biometric signature (e.g., one based oncardiac morphology, or a combination of one or more parameters detected,derived using the device 100) of a wearer of the device 100 can be usedin conjunction with location data to determine that a wearer isproximate to an access point 3310 such as a door or turnstile. Anetwork-connected lock or another access control mechanism 3320associated with the access point 3310 can be activated based ondetermining that the biometric signature corresponds to a wearerauthorized to access the corresponding access-controlled premises.

In some implementations, information related to the biometric signatureof the user can be provided to the access control mechanism 3320 via aremote server 3330 that communicates with the device 100. For example,the remote server 3330 can determine, based on data received from thedevice 100, whether a biometric signature of the user corresponds to auser authorized to access the controlled premises. If the server 3330determines that the user is authorized to access the premises, theserver 3330 can then send a signal to the access control mechanism 3320to unlock the access point 3310. In some implementations, thecommunications between the server 3330 and the device 100 can be via alocal hub 3340 (e.g., a proximity sensor) that communicates with theserver 3330 to forward information received from the device 100. In someimplementations, the local hub 3340 can be configured to process theinformation received from the device 100 and directly transmit a signalto the access control mechanism 3320 accordingly. The access controlmechanism can also be configured to communicate directly with the device100. In such cases, information from the device 100 is transmitted tothe access control mechanism 3320, which unlocks itself upondetermining, based on the received information, that the correspondinguser is authorized to access the controlled premises.

In some implementations, the biometric signature can be used to allowthe wearer to access/operate a vehicle or another access-controlledmachine. This is illustrated in the example depicted in FIG. 34. In theexample of FIG. 34, data from the device 100 can be used to identifywhether an individual is authorized to operate a vehicle or machine3410, and/or determine whether the physical and/or mental state of theindividual is appropriate for handling or operating the vehicle ormachine. In some implementations, information about the user can beprovided from the device 100 to a remote server 3430 either directly orvia a transceiver module 3440 deployed on the vehicle or machine. Theremote server 3430 (or the transceiver module 3440) can determine, basedon data received from the device 100, whether a biometric signature ofthe user corresponds to a user authorized to access the controlledpremises. The server 3430 (or the transceiver module 3440) can alsodetermine, for example, whether the user possesses sufficientmental/physical capability for operating the vehicle or machine. In oneexample, data from the device 100 can be used to prevent a pilot fromoperating an airplane if his/her vital signs indicate an alertness levelless than a threshold. In another example, data from the device 100 canbe used to prevent a driver from operating a vehicle if his/her stresslevel is determined to be higher than a threshold level. This can help,for example, reduce occurrences of stress-related traffic issues (e.g.,road rage) and accidents. In some implementations, if the server 3430determines that a user's mental/physical state is not suitable foroperating the vehicle or machine, the server 3430 can then send a signalto the transceiver module 3440 to shut down the vehicle or machine, orotherwise alert the user about the situation. In some implementations,the server 3430 (or the transceiver module 3440) can send a signal tothe device 100 to alert the user. For example, if the alertness of theuser is waning during the operation of the vehicle (e.g., because of theuser dozing off on the wheel), a signal can be sent to the device 100 toalert the user to take corrective measures.

In some implementations, the device 100 can be configured to communicatewith the transceiver module 3440 of the vehicle. In such cases, thetransceiver module 3440 can be configured to provide feedback to othermodules in the vehicle based on data received from the device 100(either directly, or via the server 3430). For example, the transceivermodule 3440 of the car can be configured to provide feedback signals toa temperature control system of the vehicle to adjust the temperaturebased on vital signs data collected by the device 100. In anotherexample, the transceiver module 3440 may use data from the device 100 toprovide feedback to a collision avoidance system that, for example,triggers an alarm (and/or slows the vehicle down) upon determining thata driver wearing the device 100 is not adequately alert. In anotherexample, the transceiver module 3440 may use data from the device 100 toturn off an operation switch (e.g., an ignition) of the vehicle. In someimplementations, in case of accidents, the data from the device 100 canbe transmitted (possibly via the transceiver module 3440) to appropriateauthorities for determining a nature of resources to be sent to theaccident scene. For example, the data from the device 100 may indicatethat a driver wearing the device 100 requires the assistance of astandard paramedic, or the data from the device 100 may indicate thatthe driver requires the assistance of a trauma unit. The data from thedevice 100 may also indicate whether the wearer of the device 100requires immediate attention from rescue workers, or alternativelywhether the wearer of the device 100 can be treated at a later time(e.g., in order to first treat others involved in the accident).

In some implementations, the device 100 can be configured to communicatewith a gaming device such as a video game console. This is illustratedin the example depicted in FIG. 35. In the example of FIG. 35, data fromthe device 100 can be used to control a gaming device 3510 based on anidentity and/or state of the body of the user. For example, one or moreof blood pressure data, respiratory rate, and heart rate obtained usingthe device 100 can be used to determine an interest level or engagementlevel of the user. If the user is determined to show more interest incertain game situations as opposed to others, the gaming device can beconfigured to adaptively provide game situations that the user isinterested in. If the data from the device 100 indicates a low level ofinterest, steps can be taken (e.g. increasing the background soundlevel, playing a stimulating track, or introducing additionalchallenges) to increase the interest level of the user. This way, gamesbeing played on the gaming device 3510 can be made more appealing to theuser. In some implementations, the gaming device 3510 can be configuredto be turned off if the user's body state is determined to be in apotentially harmful condition. For example, if the blood pressure orheart rate data from the device 100 indicates that the stress level ofthe user is above a threshold, the gaming device can be instructed toshut down to prevent the user from continuing to play.

In some implementations, information from the device 100 can be providedto a remote server 3530 either directly, or via a local hub 3540 thatcommunicates with the server 3530. The information from the server 3530can also be transmitted, for example, either directly or via the localhub 3540 to the gaming device 3510. In some implementations, the gamingdevice 3510 can be configured to receive data directly from the device100 (or via the local hub 3540) and change the game situationsaccordingly.

In some implementations, operations of the entertainment or gamingdevices can be linked to data obtained from the device 100. For example,if a user opts to force himself to exercise, he can choose aconfiguration in which a gaming device 3510 or TV 3520 will be switchedon only if he has exercised for a predetermined length of time during agiven time period. In some implementations, if data from the device 100indicates that the user has fallen asleep, the entertainment device(e.g., the TV 3520) may also be switched off based on such data.

Further, as shown in the example depicted in FIG. 36, the device 100 canalternatively or additionally be linked to other types of devices, suchas lighting units 3610, thermostats 3620, etc., that can be adjustedbased on data from the device 100. For example, biometric signature orhealth data obtained using the device 100 can be used in determining ifa user is hot or cold, and the thermostat 3620 can be adjustedaccordingly. In another example, data from the device 100 can be used indetermining that a user is approaching a room, and the lights in theroom can be turned on via communications with the lighting unit 3610.The data about the user can be provided to the lighting unit 3610 orthermostat 3620 via a remote server 3630 that communicates with thedevice 100. In one example, if the server 3630 determines, based on datareceived from the device 100, that the user is feeling too cold, theserver 3630 can then send a signal to the thermostat 3620 to increasethe temperature of the room. In some implementations, the communicationsbetween the server 3630 and the device 100 can be via a local hub 3640(e.g., a proximity sensor) that communicates with the server 3630 toforward information received from the device 100. In someimplementations, the local hub 3640 can be configured to process theinformation received from the device 100 and directly transmit a signalto, for example, the lighting unit 3610 or the thermostat 3620,accordingly. In some implementations, the network connected lightingunit 3610 or thermostat 3620 can be configured to communicate directlywith the device 100. In such cases, information from the device 100 canbe transmitted to the thermostat 3620, which adjusts the temperatureupon determining, based on the received information, that thecorresponding user uncomfortable at a current temperature setting. Insome implementations, network connected devices such as the lightingunit 3610, thermostat 3620, gaming device 3510, or TV 3520, can beturned off or adjusted upon receiving data indicating that the user hasfallen asleep.

The interest level or engagement level determination, as described abovewith respect to a gaming device, can also be used for otherapplications. For example, upon authorization from a user, suchinformation may be used by a dating or matchmaking service. For example,by reviewing a user's vital signs while the user is on a date, adetermination can be made whether the user is interested in the otherperson or not. If the interest level is not determined to satisfy athreshold level, the dating or match-making service may refrain fromsuggesting persons with similar profiles. On the other hand, if theinterest level is determined to be high (i.e., the interest levelsatisfies a threshold condition), the dating or match-making service maysuggest to the user other persons with similar profiles. The interestlevel based suggestions can be provided, for example, by a processingdevice that receives the user's data and retrieves potential matchesfrom a database. In some implementations, the process can be madecompletely automated to avoid the user's personal data being exposed tohuman personnel. In some implementations, the user's data can beanonymized such that a particular user cannot be identified by humanpersonnel. In some implementations, some of the data or feedbackreceived from the device 100 can be stored within a profile of the user(based on authorization and permissions from the user) to suggest futurematches that the user is more likely to be interested in.

In some implementations, information based on the data collected by thedevice 100 can be made available to the user, for example, via anapplication executing on a smartphone device. The application caninclude one or more user interfaces that allow the user to review thevariations over the course of a particular time period (e.g., a day,overnight, a week, or a month) or during a particular event (e.g., ameeting, an exercise session, or a date). Examples of such userinterfaces 3900, 3925, and 3950 are shown in FIGS. 39A-39C. A userinterface such as the example user-interface 3900 can enable a user tosee how various events in his/her life affect stress levels, andpossibly take action accordingly. For example, the user interface 3900can indicate that the user tends to become stressed when attending towork-related e-mails late at night. The user may then make a consciouseffort to avoid looking at work-related emails late at night toalleviate stress. If a particular activity is determined to have abeneficial effect on the user, the user can make an effort to increasesuch activities in his/her daily life. The user interface 3900 caninclude suggestions for improving stress levels, and show a graphicalrepresentation of the stress level variations over a period of time(e.g., a week).

In some implementations, a user interface 3925 can show variations ofthe vital signs during a certain activity (e.g., listening to music orrunning) For example, the user interface 3925 can show variation inheart rate for a running session and graphically compare the variationwith other baselines such as the user's own variation from a previoustime, or a professional athlete's variations for a similar activity. Theuser can then determine if his/her fitness level is improving ordeteriorating. In some implementations, a user interface such as theexample user interface 3950 can be configured to display various vitalsignals (e.g., heart rate, cardiac power, heart rate volume, recoveryrate, etc.) related to the cardiac health of the user.

FIG. 37 shows an example screenshot 3700 on a mobile phone 3702 of awearer for the wearer to view and share his or her blood pressureresults. In this example, the wearer's average blood pressure is 136/86mmHg. A graph displays the wearer's blood pressure over a number ofdays. The wearer has the option to share the blood pressure data withother people via a secure link. The wearer can also choose to shareother information with other people, such as the wearer's medicationdata, activity data, and sleep data.

An example process 3800 of providing information related to theprocessed data to a remote device is shown in FIG. 38. A machine, suchas a processor, that receives information from the optical sensors 110of the device 100 can perform one or more steps of the process 3800. Insome implementations, the machine can include the computing device 115described above with reference to FIG. 1B. In the process 3800,initially, data in a first dataset that represents time-varyinginformation about at least one pulse pressure wave propagating throughblood in a subject can be processed (3802). Data in a second datasetthat represents time-varying information about motion of the subject canalso be processed. The data can be acquired at a location of the subject(e.g., the arm or the wrist of the subject). Information related to theprocessed data can then be provided to a remote device (3804). Theremote device can be a server, a thermostat, a light, an entertainmentdevice, a television, an audio output device, or a gaming device. Theremote device can operate based on the processed data.

Computing Device

FIG. 40 is block diagram of an example computer system 4000 that can beused for performing one or more operations related to the technologydescribed above. In some implementations, the computer system 4000 canbe used to implement any portion, module, unit or subunit of the device100, or computing devices and processors referenced above. The system4000 includes a processor 4010, a memory 4020, a storage device 4030,and an input/output device 4040. Each of the components 4010, 4020,4030, and 4040 can be interconnected, for example, using a system bus4050. The processor 4010 is capable of processing instructions forexecution within the system 4000. In one implementation, the processor4010 is a single-threaded processor. In another implementation, theprocessor 4010 is a multi-threaded processor. The processor 4010 iscapable of processing instructions stored in the memory 4020 or on thestorage device 4030.

The memory 4020 stores information within the system 4000. In oneimplementation, the memory 4020 is a computer-readable storage devicethat includes a non-transitory computer readable medium. In general,non-transitory computer readable medium is a tangible storage medium forstoring computer readable instructions and/or data. In some cases, thestorage medium can be configured such that stored instructions or dataare erased or replaced by new instructions and/or data. Examples of suchnon-transitory computer readable medium include a hard disk, solid-statestorage device, magnetic memory or an optical disk. In oneimplementation, the memory 4020 is a volatile memory unit. In anotherimplementation, the memory 4020 is a non-volatile memory unit.

The storage device 4030 is capable of providing mass storage for thesystem 4000. In one implementation, the storage device 4030 is acomputer-readable medium. In various different implementations, thestorage device 4030 can include, for example, a hard disk device, anoptical disk device, or some other large capacity storage device.

The input/output device 4040 provides input/output operations for thesystem 4000. In one implementation, the input/output device 4040 caninclude one or more of a network interface devices, e.g., an Ethernetcard, a serial communication device, e.g., an RS-232 port, and/or awireless interface device, e.g., and 802.11 card. In anotherimplementation, the input/output device can include driver devicesconfigured to receive input data and send output data to otherinput/output devices, e.g., keyboard, printer and display devices.

Although an example processing system has been described in FIG. 40,implementations of the subject matter and the functional operationsdescribed in this specification can be implemented in other types ofdigital electronic circuitry, or in computer software, firmware, orhardware, including the structures disclosed in this specification andtheir structural equivalents, or in combinations of one or more of them.Implementations of the subject matter described in this specificationcan be implemented as one or more computer program products, i.e., oneor more modules of computer program instructions encoded on a tangibleprogram carrier, for example a computer-readable medium, for executionby, or to control the operation of, a processing system. The computerreadable medium can be a machine-readable storage device, amachine-readable storage substrate, a memory device, or a combination ofone or more of them.

The term “processing system” encompasses all apparatus, devices, andmachines for processing data, including by way of example a programmableprocessor, a computer, or multiple processors or computers. Theprocessing system can include, in addition to hardware, code thatcreates an execution environment for the computer program in question,e.g., code that constitutes processor firmware, a protocol stack, adatabase management system, an operating system, or a combination of oneor more of them.

A computer program (also known as a program, software, softwareapplication, script, or code) can be written in any form of programminglanguage, including compiled or interpreted languages, or declarative orprocedural languages, and it can be deployed in any form, including as astand-alone program, a module, component, subroutine, or other unitsuitable for use in a computing environment. A computer program does notnecessarily correspond to a file in a file system. A program can bestored in a portion of a file that holds other programs or data (e.g.,one or more scripts stored in a markup language document), in a singlefile dedicated to the program in question, or in multiple coordinatedfiles (e.g., files that store one or more modules, sub programs, orportions of code). A computer program can be deployed to be executed onone computer or on multiple computers that are located at one site ordistributed across multiple sites and interconnected by a communicationnetwork.

Computer readable media suitable for storing computer programinstructions and data include all forms of non-volatile memory, mediaand memory devices, including by way of example, semiconductor memorydevices, e.g., EPROM, EEPROM, and flash memory devices; magnetic disks,e.g., internal hard disks or removable disks; magneto optical disks; andCD ROM and DVD ROM disks. The processor and the memory can besupplemented by, or incorporated in, special purpose logic circuitry.

Implementations of the subject matter described in this specificationcan be implemented in a computing system that includes a back endcomponent, e.g., a data server, or that includes a middleware component,e.g., an application server, or that includes a front end component,e.g., a client computer having a graphical user interface or a Webbrowser through which a user can interact with an implementation of thesubject matter described is this specification, or any combination ofone or more such back end, middleware, or front end components. Thecomponents of the system can be interconnected by any form or medium ofdigital data communication, e.g., a communication network. Examples ofcommunication networks include a local area network (“LAN”) and a widearea network (“WAN”), e.g., the Internet.

The computing system can include clients and servers. A client andserver are generally remote from each other and typically interactthrough a communication network. The relationship of client and serverarises by virtue of computer programs running on the respectivecomputers and having a client server relationship to each other.

While this specification contains many specific implementation details,these should not be construed as limitations on the scope of what may beclaimed, but rather as descriptions of features that may be specific toparticular implementations. Certain features that are described in thisspecification in the context of separate implementations can also beimplemented in combination in a single implementation. Conversely,various features that are described in the context of a singleimplementation can also be implemented in multiple implementationsseparately or in any suitable subcombination. Moreover, althoughfeatures may be described above as acting in certain combinations andeven initially claimed as such, one or more features from a claimedcombination can, in some cases, be excised from the combination, and theclaimed combination may be directed to a subcombination or variation ofa subcombination.

Similarly, while operations are depicted in the drawings in a particularorder, this should not be understood as requiring that such operationsbe performed in the particular order shown or in sequential order, orthat all illustrated operations be performed, to achieve desirableresults. In certain circumstances, multitasking and parallel processingmay be advantageous. Moreover, the separation of various systemcomponents in the implementations described above should not beunderstood as requiring such separation in all implementations, and itshould be understood that the described program components and systemscan generally be integrated together in a single software product orpackaged into multiple software products.

A number of implementations of the invention have been described.Nevertheless, it will be understood that various modifications may bemade without departing from the spirit and scope of the technologydescribed in this document. Accordingly, other implementations arewithin the scope of the following claims.

1-30. (canceled)
 31. A method comprising: obtaining, using a firstsensor, a first dataset that represents time-varying information aboutat least one pulse wave propagating through blood in a subject;obtaining, using a second sensor, a second dataset that representstime-varying information about motion of the subject, wherein the firstand second datasets are obtained from a particular portion of the bodyof the subject; processing one or both of the first dataset and thesecond dataset to determine a reaction of the subject to a medication;and transmitting, using a wireless transmission module, informationabout the medication based on the determined reaction of the subject tothe medication.
 32. The method of claim 31, further comprisingdetermining a recommended medication regimen for the subject.
 33. Themethod of claim 32, wherein the recommended medication regimen comprisesone or more recommended dosage timings and one or more recommendeddosage amounts.
 34. The method of claim 31, wherein the informationabout at least one pulse wave propagating through blood in the subjectcomprises photoplethysmographic (PPG) data and the information aboutmotion of the subject comprises one or both of motioncardiogram (MoCG)data and gross motion data.
 35. The method of claim 31, wherein thedatasets are acquired continuously.
 36. The method of claim 31, whereinthe datasets are acquired by a device worn by the subject, and thedevice does not reduce a mobility of the subject.
 37. The method ofclaim 31, wherein the first and second datasets are obtained from aparticular portion of the body of the subject.
 38. The method of claim37, wherein the particular portion of the body of the subject is alocation on an arm of the subject.
 39. The method of claim 31, whereinthe reaction of the subject to the medication comprises one or both of:a reaction related to the subject taking the medication; and a reactionrelated to the subject not taking the medication.
 40. The method ofclaim 31, further comprising: determining, based on one or more of i)the first dataset, ii) the second dataset, and iii) the reaction of thesubject to the medication, that the subject has potentially missed adose of the medication; and transmitting, using the wirelesstransmission module, a notification indicating that the subject haspotentially missed the dose of the medication.
 41. The method of claim40, wherein the reaction of the subject to the medication is determinedand stored prior to determining that the subject has potentially misseda dose of the medication.
 42. The method of claim 40, whereindetermining that the subject has potentially missed a dose of themedication comprises determining, based on one or both of the first andsecond datasets, that a blood pressure of the subject has crossed athreshold.
 43. The method of claim 42, further comprising: identifying afirst point in the first dataset, the first point representing anarrival time of the pulse wave at a first body part of the subject;identifying a second point in the second dataset, the second pointrepresenting an earlier time at which the pulse wave traverses a secondbody part of the subject; and computing a pulse transit time (PTT) as adifference between the first and second points, the PTT representing atime taken by the pulse wave to travel from the second body part to thefirst body part of the subject, wherein the PTT is used in determining ablood pressure of the subject.
 44. The method of claim 43, wherein thefirst and second datasets are obtained from the first body part, and thesecond body part is an artery extending from the heart of the subject.45. The method of claim 44, wherein the second body part is the aorta ofthe subject.
 46. The method of claim 40, wherein determining that thesubject has potentially missed a dose of the medication comprisesdetermining, based on one or both of the first and second datasets, thata heart rate of the subject has crossed a threshold.
 47. The method ofclaim 40, wherein determining that the subject has potentially missed adose of the medication comprises determining, based on one or both ofthe first and second datasets, that a respiratory rate of the subjecthas crossed a threshold.
 48. The method of claim 31, wherein determiningthe reaction of the subject to the medication comprises determining ablood pressure of the subject.
 49. The method of claim 48, wherein theblood pressure of the subject is determined periodically.
 50. The methodof claim 31, wherein recommended dosage timings and amounts of themedication are determined so as to maintain a blood pressure of thesubject within a defined range.
 51. The method of claim 31, whereindetermining the reaction of the subject to the medication comprisesdetermining one or more of a heart rate, a regularity of the heart rate,a stroke volume, and a cardiac output of the subject.
 52. The method ofclaim 31, wherein recommended dosage timings and amounts of themedication are determined so as to maintain a heart rate of the subjectwithin a defined range.
 53. The method of claim 31, wherein recommendeddosage timings and amounts of the medication are determined so as tomaintain one or both of a stroke volume and a cardiac output of thesubject within a defined range.
 54. The method of claim 31, whereindetermining the reaction of the subject to the medication comprisesdetermining a temperature of the subject.
 55. The method of claim 31,wherein recommended dosage timings and amounts of the medication aredetermined so as to maintain a temperature of the subject within adefined range.
 56. The method of claim 31, wherein determining thereaction of the subject to the medication comprises determining arespiratory rate of the subject.
 57. The method of claim 31, whereinrecommended dosage timings and amounts of the medication are determinedso as to maintain a respiratory rate of the subject within a definedrange.
 58. A method comprising: receiving, from a wireless device, afirst dataset that represents time-varying information about at leastone pulse wave propagating through blood in a subject; receiving, fromthe wireless device, a second dataset that represents time-varyinginformation about motion of the subject, wherein the first and seconddatasets are obtained from a particular portion of the body of thesubject; processing one or both of the first dataset and the seconddataset to determine a reaction of the subject to a medication; andtransmitting information about the medication based on the determinedreaction of the subject to the medication.
 59. A system comprising: awireless device comprising: a first sensor configured to obtain a firstdataset that represents time-varying information about at least onepulse wave propagating through blood in a subject; a second sensorconfigured to obtain a second dataset that represents time-varyinginformation about motion of the subject, wherein the first and secondsensors are configured to obtain the first and second datasets from aparticular portion of the body of the subject; one or more processingdevices configured to process one or both of the first dataset and thesecond dataset to determine a reaction of the subject to a medication;and a transmission module configured to transmit information about themedication based on the determined reaction of the subject to themedication.
 60. A system comprising: memory; and one or more processorsconfigured to: receive a first dataset that represents time-varyinginformation about at least one pulse wave propagating through blood in asubject; receive a second dataset that represents time-varyinginformation about motion of the subject, wherein the first and seconddatasets are obtained from a particular portion of the body of thesubject; process one or both of the first dataset and the second datasetto determine a reaction of the subject to a medication; and transmit, toa remote device, information about the medication of the subject basedon the determined reaction of the subject to the medication.